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1, THIS BOQK 20 eminent scholars, researchers, and research administrators 
present their latest thinking about the processes and conditions of human 
leaming, the processes and programs of instniction, and the application of 
research and development strategies to educational problems. 


As the editors point out in the Preface, the application of research and develop- 
ment strategies for the improvement of educational practices {fs a ploncering 
venture begun in 1964 under the provistons uf the Cooperative Research 
Program of the United States Office of Education and now continuing through 
Title 1V of the Elementary and Secondary Education Act of 1965, 


Workirg from a proposed model outlined in Chapter 16, the editors have 
organized the book around the major components of an instructional system. 


Basic to the improvement of education is knowledge about the processes end 
conditions necessary for efficient leaming. In Part I, four authors discuss 
retention and recall, thought processes, creative thinking, and motivation. 


A maior component of an instructional system is subject matter content and 
sequence, In Part Il, five authors provide scholarly insights into the structures of 
such disciplines as mathenirtics, science, English, and reading. They state or 
imply that the structure of the discipline itself, as formulated by one or more 
scholars, has provided much of the basis for recent curriculum development. 


Instructional materials and media can be -onsidercd as the interface between 
the learmer and the subject matter being learned. In Part III, the discussion 
focuses on instructional television, on some aspects of the status, defccts, 
and needs of instructional research, and on computer-based instruction. 


Texching methods, or the interactions which occur between a teacher and 
students, have been the subject of many research studies in the last decades. 
In Part IV, two recent paradigms for research on teaching are presented, 
One approach discusses what is commonly called rafcro-teaching and the other 
{is Interaction analysts. 


Finally, {n Part V, three research administrators discuss the current application 
of research and development strategies for the improvement of educational 
practices. The present scene {n educational R&D is one of rapid change 
brought about largely by the advent of Federal funding. The development of 
these changes with reference to Federal involvement {s traced in one chapter. 
In another chapter the focus and programs of the Wisconsin Research and 
Development Center for Cognitive Learning are described. And in the final 
chapter an author presents an output-oriented mode! of R&D. 


Research and Development Toward the Improvement of Education grows out 
of a colloquium series sponsored recently by the Wisconsin R&I) Center, The 
book has been published by Dembar Educational Research Services, Inc., as.a 
contribution to the field, without firancial support other than that 

engendered by sales. 
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mamma PREFACE 


THE FIRST systematic attempt to apply research and development 
strategies to education occurred with the sstablishment of four research and 
development (R&D) centers in 1964 as part of the Cooperative Research Pro- 
gram of the United States Office of Education, The K & D Centers program attempted 
to combine the best featuros of the separate programs of the U.S.O.E.1 basic 
and applied research, development, curriculum improvement, and demonstration. 
Thus, an R&O Center is organized to conduct basic research related to a sig- 
nificant problem area; to develop substantive and proce 'usal products and con- 
duct related research; to demonstrate the resul!s of the research and develop- 
ment activities in a few school settings; and to take initiative for the eventual 
widespread dissemination of the research results and tested products. An R&D 
Center, located on a university campus, draws its professorial staff from the be- 
havioral sciences, subject disciplines, communications, educational methodology, 
and other fields. It is a community of scholars, capable of dealing with a prob- 
lem area effectively. In an R&D Center, then, human and financial resources 
are concentrated on o nariicula. problem area over an extended period of time 
in order to secure a better understanding of that problem crea and !o improve 
related educational practices. Since 1964 the number of R&D Centers has in- 
creased from four to nitie. 

Our major universities, incituding the nine where R &O Centers are 
located, have a large pool of able researchers and many other resousces. How- 
ever, ine development and application of research and development strategies to 
education is a pioneer venture. Developing iinaginative strategies for eatending 
knowledge abuul cognitive learning and improving related educational practices 
1s @ conlinving concern of the Wisconsin Research and Development Center for 
Cognitive Learning. 

In this Center, basic research is done to extend knowledge abou! 
the processes of cognitive learning, particularly those associated wilh concept 
learning and problem solving, and about the conditions associoted with efficiency 
of learning in the cognitive domain. Some of this knowledge goes immediately 
into the development of instructional systems. A second objective of ‘he Wiscton- 
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sin R&D Center is the improvement of educational practices in the cognitive 
domain. The development and refinement of an instructional system related to 
a subject field, such as mathematics, requires appropriate strategies for dealing 
with the various components independently and also for interreloting thetn so 
that desired behavioral objectives are achieved. Three impoituni components of 
the system are subject matter content and sequence; instructional materials and 
media; and instructional methods, including teacher behaviors and learner activi- 
tles. A colloquium series was organized to bring information to the Center staff 
regarding these research and development strategies. 


A 


One part of this colloquium series was concerned with research on © 


learning that has fairly direct implications for improving education. (A previous 
volume, Analyses of Concept Learning, Academic Press, 1966, on the other kand 
ovilined more basic research.) The main portion of the colloquium series was 
addressed to development and related ressarch dealing with subject matter con- 
tent and sequence, instructional media, and instructional methods. This volume 
is organized in the same pattern. 

As might be expected, the research methods reported by the partici- 
ponts are varied. In Part I, Endel Tulving of the University of Toronto shows that 
substantive results concerning information storage ond retrieval, derived from the 
typical controlled laboratory experiment, require us to reconsider our notions about 
why pevsons do not effectively reproduce information they once learned. Kenneth 
Lovell, University of Leads, shows that the charting of thought processes develop- 
mentally is moving ahead rapidly by means of Piaget's methods and refined vari- 
ants thereof. Martin Covington, University of California, describes a straightfor- 
ward aitempt to develop materials designed to facilitate productive thinking in 
school! children and to utilize the material in extending knowledge about chil- 
dien’s productive thinking skills. Here there is a continuous interweaving cf theor- 
izing, developing material based on theory, and research activities concerning 
the abilities nurtured by the instructional program. Richard DeCharms and Vir- 
ginia Carpenter of Washington University and Lindenwood College proceed in a 
similior manner as Covington; however, their main concern is with motivational 
theory and the measurement of strength of motivation in culturally disadvantaged 
children. In these chapters substantive research resulls and theory properly receive 
most attention; however, sufficient attention is given to the procedures to make 
cleor that extending knowledge obout processes and conditions of tearning can 
be accomplished by a variety of strategies. 

tn Part Il, somewhat similar c ‘rleslum development and research 
procedures are outlined by the first three au‘s~s. 7 O, Begle, Stanford Univer- 
sity, outlines development and related research i mal, eimatics, including his expe- 
riences with the widely known School Mathematics Study Group. Arthur Liverriore, 
AAAS Commission on Seience Education, briefiy describes the large science cur- 
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riculum projects, kindergarten to Grade 12, but gives major attention to the 
elementary program: Science—A Process Approach. Robert C. Pooley, The Uni- 
versity of Wisconsin, also synthesizes many research and development activities 
related to the teaching of literature, composition, and language but gives par- 
ticular attention to the Wisconsin English-Language Arts Project. Common to the 
curriculum development strategies in these subjects is an increasing emphasis on 
the structure of the discipline and a decreasing emphasis on other criteria such 
as social utility, difficulty, children’s interests, atid possible transfer to other sub- 
ject fields. In the last two chapters of Part Il, Wayne Otto, The University of Wis- 
consin, describes a rigorous and productive research effort in reading, and Myron 
Rosskopf, Teachers College, Columbia University, relates curricuium «evelopment 
in mathematics to recent research in concept learning. 

In Part lit, Wilbur Schramm, Stanford University, reysorts information 
on the use of instructional television. Three case studies are presented in suffi- 
cient detail to renew confidence in the value of careful observation in the natural 
environment by an interested, objective scholar. Lawrence Stolurew, Harvard Uni- 
versity, describes the computer-based instructional system, SOCRATES, that he 
developed while at the University of Illinois. Problems associated with develop- 
ment of the hardware ard software are noted briefly or may be iaferred. The use 
of the computer in research to improve instruction and to validote behavior theory 
is noteworthy, Arthur Lumsdaine, University of Washington, deals with research 
and development in the entire field of instructional media. 

In Part IV, N. L. Gage, Stanford University, outlines a recent con- 
cept, micro-teaching, and related research strategies. The concept romises to 
generate much research and development on instructional methods. In... ,,roach, 
the teacher and student rather than the content, hardware, or pr yrom, are 
central tn the educative process. Ned Flanders, University of Michigan, describes 
the new directions of his long-standing research on teacher-studsni interaction anal- 
ysis. In the current model, the number of categories of interactions is reduced. By 
employing a computer for rapid feedback, the current model holds much promise 
of providing immediate (daily) correction of teacher—siudent interactions and also 
for supplying the extensive research data required in validating and extending 
the theoretical basis of the systam of inferactio 1 analysis. 

Part V of this volume contains pcj*ts which did not arise from the 
colloquium series. They are included because th.» contribute to the survey of 
research and development aclivities in edi to us particularly very re “ent trends. 
lovis Bright and Hendrick Gideonse of the U.S.>.£ outline the brov4 J.veep of 
research and development strategies and activities, resulting from the passage 
of the Elementary and Secondary Education Act of 1965. Included here are the 
R&D centers, regional educational laboratories, Title Ill centers, and other R&D 
instrumentalities funded by other governmentol agencies. The comprehensive edu- 
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cational research and development program of the U.S.O.€. merits careful alten- 
tion by anyone interested in the improvement of education. A more complete 
descriptiun of one federally-supported R & D instrumentality, the Wisconsin Re- 
search and Development Center for Cognitive Learning, follows the chapter by 
Bright and Gideonse. Here we review the main components of a Center and their 
interrelations. Particular attention is given to the problem area of the Center; 
its programs, strategies, and oulcomes; staffing pattern; administrative organi- 
zation; locus of operation; and source and stability of funding. 

In ao new field, models are required as guides to operations. Many 
models have been outlined to indicate how systematic improvement in educalion 
might be managed through sequential research, development, and disseminalion. 
None of the models thus far appecred particularly appropriate to the current scene. 
Hendrick Gideonse, active privately and not as a U.S.O.E. official, has been 
atlempting for some time to formulale a comprehensive model that would simul- 
taneously meet the test of reality and also provide a more adequate conceptuali- 
zation of Research and Development octivities designed to improve education. 
Fortunalely his conceptualization was completed at the time the volume was in 
final editing. The Gideonse model is especially relevant to those who have been 
concerned with relating reseorch, develcpment, and educational improvement. 

The colloquium series was planned and executed by the editors of tuis 
volume; Herbert J. Klausmeier assumed primary responsibility for organizing the 
colloquium serief around topical areas of relevance to the R & D Center. He identi- 
fied most of the participants and the broad organization framework for each par- 
ticipant’s contribution. George T. O'Hearn participated in the planning and organi- 
zation of the colloquium series, worked out the presentation schedu'e and other 
delails with each participant, and handled editorial queries from the publisher. 
He also edited the papers and wrole the introductions to each part. Barbara 
Kennedy, Project Assistant, read the papers, checked the references, and pvt 
the references in APA style. The Wisconsi« Research and Development Center for 
Cognilive Learning, the education research and development community, and 
the teaching profession generally is indebted to the internationnliv recognized 
scholars who made this volume possible. 


Herbart J. Klausmeier, Profess. r of 
Educationol Psychology; Director, 
Wisconsin Research and Development 
Center for Cognitive learning 


Georg T. O'Hearn, Associate Professor, 

Acting Director, Division of Education 

University of Wisconsin-Green Boy 
September 1968 
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LLohnuiunceiwisy Conditions and Processes of Learning 


UNDERSTANDING Iearning phenomena and conditions associated 
with efficiency of learning is a foremost concern of psychologists throughout West- 
ern civilization. Increasingly sophisticated experiments are being executed in labo- 
ratory and non-luboratory settings. Representative of work in this vast domain, 
with implications for education, are the following: 

a) controlled observations to infer thought processes. 

b) contro!led experimentation in the laboratory to extend our knowledge of 

human memory. 

c) development of material and related research to nurture the creative abili- 
ties of school children. 
development of dependent measures to extend a motivational theory to 
school settings. 

Permanence of learning necessarily requires the storage and recall 
of information. In Chapter 1, Endel Tulving discusses various verbal learning and 
memory experiments conducted in the laboratory at the University of Toronto, 
and suggests that ‘'the success of retention and recall is to a large extent deter- 
mined by what the subject does with the material he is to memorize, by the meth- 
ods he uses to organize the material, and by the cues that he uses to effect the 
recall of the material.’ The data reported by Tulving support his contention that 
the ability to recall is determined more by the limitation of the retrieval mechanism 
than by the limitation of the storage mechanism, He concludes: 

. that understanding of many phenomena of verbal learning and memory would 

be enhanced if we adopted u basic orienting attitude. That a person's mnemonic perform- 

ance depends fo a very large extent on the method that he wittingly or unwittingly 

uses fo organize the material. The important function of such organization is to facili- 

fate retrieval of information from the memory storage. 

The inferring of thought processes has always been difficult but is 
essential to exp aining changes that occur ontogenetically. In ‘Developmental Proc- 
esses in Thought,'' Kenneth Lovell, University of Leeds, reports on the stages of 
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human intellectual growth hypothesized by Jean Piaget and his followers. Lovell 
suggests that the schemas interiorized by the child undergo constant modifica- 
tion and are the basis and limitation of all subsequent learning. '‘The implication of 
Piaget's findings is that we need to beyin to stimulate the intellectual growth of 
the child in the early weeks of life." Research reported by Lovell confirms the 
general classification of the developmental stages of thought hypothesized by 
Piaget, and also indicates the importance of previous learning and the cultural 
milieu on the child. 

Martin Covington in his paper ‘Promoting Creative Thinking in the 
Classroom'' states, ‘In order te take full advantage of the unrestrictive atmcs- 
phere the child must first come to understand what constitutes creative ideas in 
the given situation, and how he ¢1n achieve such ideas for himself... In order 
to think creatively the child must icave at his disposal a repertoire of creative think- 
ing skills. To name a few: the ability to recognize gaps in exist’ 1g information; a 
facility for formulating relevant questions, and a facility to the demands of the 
task so one can adequotely judge the suitability of the proposed ideas." 

The General Problem Solving Program described by Covington repre- 
sents an attempt to initiate creative thought in students within a school setting 
and within a curriculum framework. The objective is to teach a number of cog- 
nitive skills which are fundamental to creative thinking and then determine whether 
such generalized skills can be applied to a specific subject matter area. 

Before specified learning can take place the learner must seek and 
accept the learning situation. The probability that an individual will seek or ac- 
cept a new learning situation is referred to as motivation by Richard deCharms 
and Virginia Carpenter. When a tendency to avoid a learning situation increases, 
i.e.., when there is a lack of motivation, the problem becomes crucial. The dis- 
cussion of this problem by deCharms and Carpenter is based on their work with 
inner-city youngsters. In their chapter “Measuring Motivation in Culturally Disad- 
vantaged Schoo! Children” the authors prepose a model of motivation in which 
@ person perceived to be originating his own behavior is called an ‘Origin’ while 
@ person perceived to be behaving in a certain way because >f an external ''power 
source" is said to be acting like a "Pawn." ‘Pawn behavior implies powerless- 
ness, but origin behavior implies freedom of choice, not necessarily the ability to 
wield power over others.” The theoretical framework of the ‘'OP’ model is dis- 
cussed in detail. The n achievement procedures developed by McClelland were 
used in measuring motivation in a sample of culturally disadvantaged schoo! chil- 
dren. The data obtained tend to support the theoretical point of view expressed. 
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Cued Recall 


EVER SINCE Hermann Ebbinghaus 
(1885) brought phenomena of memory under experi- 
mental scrutiny in the psychological laboratory and 
William James (1890) eloquently epltomized the dis- 
tilled wisdom of other great thinkers on the subject, 
research on remembering and forgetting has been 
growing by leaps and bounds. Everyone agrees that 
this research has by now produced an !mmense quan- 
tity of empirical data, but fcw are willing to claim 
that it has created any genuine novel conceptual in- 
sights. More often than not, new empirical findings 
have generated more heat than light at the theoreti- 
cal level. Thus, despite everything we beileve we 
know about the role of a multitude of experimentally 
manipulable varlables on verbal learning, retention, 
and recall, we seem to be no nearer to the under- 
standing of the basic nature of memory than were 
psychologists and other writers of previous genera- 
tione. If someone asked us today what do we know 
that is truly worth knowing and that was not known 
to Ebbinghsus and Jatres, we would be hard pressed 
to provide a convincing answer. 


Those who share this pessimistic assessment of 
the state of affairs in research on verbal learning 
and memory have been quick to suggest remedies, 
but their advice has been inconsistent. Some have 
argued that experimental conditions between labora- 
tories be more rigidly standardized, others would 
like to see a greater diversity of methods. Some ad- 
vise that only iimited sets of carefully calibrated ma- 
terials be used, others insist on a fuller variety of 
materials. Some are convinced that true understand- 
ing of memory can be achieved only through marm- 
moth parametric stvdies, others are equally certain 


pam Endel Tulving 


University of Toronto 
Toronto, Ontario 


that at least for the tim’, being the solution lies in 
simpler ‘‘miniature”’ experiments. Iam listing 
these conflicting attitudes not to pass judgment on 
them, but rather as a background for my own favor- 
ite complaint about the general orientation of re- 
search in thls broad field. 


My complaint is that far too little attention has 
been devoted to the implications of the well-known 
fact that subjects in verbal learning and memory ex- 
periments are not passive organisms. Too many 
students of human learning and memory have predi- 
cated the interpretation of their data and the for mu- 
lation of their theoretical statements on the basic 
assumption that in learning and remembering cer- 
tain things happen to the person or certain vents 
take place in his nervous system, and that these 
events are governed by nothing more than the present 
and past inputs. Eventually, of course, sclencc may 
be able to interpret all phenomena of memory with- 
out recourse to a highly sophisticated, conscloug, ac- 
tive, thinking organism, but at the present time 
nothing much seems to be gained, and a good deal 
may be lost, if we pretend that the articulate human 
subject is a passive recipient of external stimula- 
tion, and that acquisition, retention, recall, trans- 
fer, interference, etc., cccurin a mental vacuwa, 
If we know anything at all about what subjects do In 
verbal learning and memory experiments, we know 
that they use plans (Miller, Galanter, and Pribram, 
1960), that they consciously and deliberately employ 
strategies (e.g., Pollack, Johnson, and Knaff, 1959) 
or mediational devices (e.g., Bugelski, 1962; Un- 
derwood and Schulz, 1960), or simply thatthey think 
(e.g., Mandler, 1965). There are some who would 
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argue that these covert activities of the subject, and 
thelr behavioral manifestations, mereiy accompany 
processes of memory and that they play no signifi- 
cant role in determining the quantity and quality of 
a person's mnemonic performance, but such views 
are rapidly losing their appeal. A great dealofevi- 
dence accumulated in recent years, added to evi- 
dence resurrected from Isolated and forgotten ex- 
periments from the past, points to the wittingor un- 
witting use of plans, strategies, and mediational de- 
vices by the subject as the sine qua non of remem- 
bering. Atfuller understanding of what the subject 
does when faced with the requirements of memory 
tasks 7! various kinds, therefore, seems Ind!spensa- 
dle for the comprehension of many, if not all, phe- 
nomena of memory. In all probability, an active 
search for such understanding vill turn out to be 
more fruitful than the mere Introduction of standard~ 
ized conditions of experimentation, calibration of ma- 
terials, or mammoth experiments. 


In the present paper I wv li deseribe some recent 
work we have been doing at .'‘vronto to probe into 
some of the long-standing problems of memory, 
Two questions that I have been particularly inter~ 
ested in are, first why is repetition effective in in- 
creasing the amount of material the sulject can re- 
call, and secondly, how does retrieval of mnemonic 
information from the memory storage take place. I 
will obviously not be able to answer these questions, 
but I would like tu offer some suggestions re’evant 
tothem. These —-uggestions are firmly anchured to 
the basic assumption that the success of retention 
and recall is to ~ large extent determined by what 
the subject does «ith the material he isto memorize, 
by the methods he uses to organize the material, 
and by the cues that he uses to effect the recall of 
retained material. The data I will report,I believe, 
will offer good support to this assumption. 


FREE RECALL AND ORGANIZATION 


The experimental data come from experiments ln 
which the subject’s task is to learn, that !s to com- 
mit to memory, aretof discrete verbal items. 
Some of these experiments are concerned with free 
recall of items, while others constitute variations 
on the theme of free recall. In the free-recall ex- 
periment the subject 1s presented with alist of 
familiar items, such as meaningful words, and his 
task is to remember as many of these items as pos- 
sible, in any order that they occur to him. Thus the 
free-recall paradigm constitutes atest for the ac~- 
quisiton, retention, and utilization of retained infor- 
mation about the membership of otherwise familiar 
{tems in an unfaniliar set. Free recall as a labor- 
atory tack, like other paradigms of verbal learning 
and memory, involves mnemonic performance of the 
kind often required of individuals outside the labora- 
tory. Ateacher’s knowledge of names of students 
ina class, a person’s memory forthe names of 
guests at a cocktail party he attended the night be- 
fore, and a child's recollection of animals he saw on 
his visit to the zvo are based on retention of infor ma- 
tion of the kind that we investigate in free-recall ex- 
periments. 


I have been particularly interested In free-recall 
phenomena for three reasons. First, the require- 


ments imposed on the mnemonic information proces- 
6ing mechanisms in the free-recalil task are neces- 
sarily present in any other paradigm. The subject 
cannot learn the order of a set of items ina serial 
learning task, or specific inter-item associations in 
© paired-assoviate task, unless be knows what items 
econstitute the set. This means that the processes in- 
volved in free recall ave lr. some ways more basic 
than those underlying inany other laboratory tasks in 
memory, and that theretore the study of these prov- 
esses constitutes a logical] starting point for the 
study of memory. Secondly, free-récall phenomena 
were ignored by students of verbal learning and 
memory for a longtime. As a consequence they 
have not yet been fitted into a relatively fixed theo- 
retical framewor as have beeii scria)- and paired- 
associate learning phenomena. Thus, when we sve 
faced with the problem of interpreting expertmental 
findings in free recall, we mre not hampered by ¢x- 
tant theoretica: notions. Thirdly, and rnost impor- 
tantly, it is easier to find out in free-recall situa- 
tions what the subject is doing when he is memoriz- 
ing 9 set of items. The task set to the subject in 
se€vial- and paired-associate paradigms is too rigidly 
prescribed by the experimenter and all that can be 
observed at the behavioral level is how well the sub- 
ject can meet the experimenter’s requirements, In 
free recall, the subject is told to recall as many 
items as possible, but he is le‘t free to recall the 
items in any order. Examination of theorder in 
which he recalls the items provides considerable in- 
sight into the subject's covert activities in the proc- 
ess of memorization. 


In multl-trial free-recall tasks, the same set of 
items is presented on a number of su.'vessive trials, 
the order of presented itoms usually varying from 
trial to trial (cf. Waugh, 19¢1), andafter each Input 
trial the subject recalls all items he can. V/hen the 
number of items the sub,ect recalls are ,lotted 
against trials, a typical negatively accelerated learn- 
ing curve results (Miller and McGill, 1952; Murdock, 
1960; Tulving, 1962a, 1964; Waugh, 1961). One of 
the questions I wish to raise is, why does such learn- 
ing, i.e., improvement in trial-to-trial recall, oc- 
cur. [have argued elsewhere (Tulving, 1962a, 164) 
that Jearning in multi-trial free recall is a conse- 
quence of the fact that the subject organizes list- 
items Into larger units of material, ‘nto subjective 
units or S-units, At any given time the subject car. 
retrieve from memory only a limited number of units 
of a particular set of materials, but the larger these 
units, that is, the more individual items each unit 
contains, the larger the number of items recalled 
(Miller, 1956a, 1956b). 


ORGANIZATION AND LEARNING 


The original evidence for this contention was pro- 
vided by the observations that the amount of organi- 
zation subjects imposed on the material incre: sed 
systematically over trials, accompanying the in- 
crease in the iumb>r of items recalled, and that 
when the amount of yractice was held constant, there 
was a sizable correiation between recall scores and 
organization scores as subject variables. Such cor- 
relational evidence, of course, isnot very compelling, 
One can justifiably argue that organization andrece ll 
are two parallel but otherwise u.related manifesta- 
tions of some common underlsing mechanism. Some 
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writers (e.g., Asch and Ebenholtz, 1962) have In- 
deed clalmed that free-recall learning occurs inde- 
pendently of any inter-item assoclations, belng a 
conseque ice of greater availability of items result 
ing from repeated presentation of items. To tha 
extent that the development of S-unlts reflects the 
development of specific inter-item assoc lations, the 
denial of the primary role of inter- item assoclations 
infree recall learning also constitutes a denial of 
the dependen-e of learning on organizatlonal proces- 
ses. How can we evaluate the hypothesized relatlon 
between organizatlon and fri-e-recall leasing: more 
directly than is possible on che basis of cvserved 
correlatlons between the twu measures? 


Two possibilitles suggest tueniselves. The first 
is t> present a set of items co the subject under von- 
ditiuns where ha n.akes repeuled resporses to the 
iteme, hiteoce not actively and deliberately wry to 
organize the materia\ into larger S-units. If learn- 
ing depends upon organiza‘ on, then such non-di- 
rected repetition should have little effect on recall- 
abillty of items. The second possibility isto in- 
struct subjects <o use effective methods of organiza- 
tlon. if learnlag depends on organizatlon, such in- 
structions wo-.id be expected to facilitate learning. 
We have do. both types of experiments. 


REPITITION AND ORGANIZATION 


At flrst glance, it may stem diti!cult to create 
cond'tions under v-hich subjects are repeatediv 
exposed to a set cf lterns and whey : they make overt 
responses to these items, Lut do not think about and 
thus organize the items. Since we intltially knew 
nothing a’sout the problems invz!ved, we decided to 
start witr the moet obvious approach, altnough I 
mu3t admit, at the time we did not have much faith 
in it. Subjects were simply shown a set of common 
words, asked to read theee words aloud a number of 
times, and then, Immediately after such reading, 
welre given the same set of words t> learn under the 
typical free-recall instructions ‘Tulv'.g, 1966). A 
cortrol group le«rned the same set of words under 
identical cond‘.ions, but without having seen the 
words befor’hand. 


The list to be fearned contained twenty-two high- 
frequency English words. In the ‘‘reading task,”’ 
the subjects In one group were skcwn each of the 
werds six times, in an uninterrupted sequence of 132 
exposures. The words were exposed one at a time 
by means of a memory drum, atthe rate of one 
word/second, and the subjects were instructed to 
call out each word as it appeared. The subjects in 
the other group went through the same procedure 
with a Het of twenty-two names, Immediately follow- 
ing the reading task, all subjectswere asked to 
learn the samc set of twenty-two words to whicn the 
first group had beer. exposed already. Typical free- 
recall instructions were given, words were pre- 
s2nted at the rate of one word/second, and at the 
end of each input phase subjects had 60 seconds for 
oral recall, Every subject recelvedtwelve learning 
telala, Thus, both groups learned the identical list 
of words under identical conditions. The only dif- 
ference was that the subjects in the Prior Acquaint- 
ance Group has just {Inlshed reading aloud the came 


FIGURE 1. Learning curves for two groups of sub- 
jects. One group recelved six trialsof prior ac- 
quaintance with the set of twenty-two words to be 
learned later, the othe: group had no such prior ac- 
quaintance. 
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words on six continuous reading “trials, ’ while the 
subjects In the No Prior Acquaintance Group had 
been ‘warmed u,”’ with a di’ereat set of words. 


The two learping curves {; 9m thls experiment 
are shown li Figure 1, The Prior Acquaintance 
Group had a small, but statistically aon- significant 
edge over the No Prior Acquainta ice Group on the 
very first tial, but nonethereafter. Over ail 
twelve trials, the mean number of words recalled 
by the former group waa 15.71, while the meannum- 
ber of words recalled by the latter group was 15. 91. 


These resi tts thus suggest that mere repetition 
of list items nad no effect on subsequent me moriza- 
tion of these items. According to the present inter- 
pretation, repetition had 10 effect because the sub- 
jects did not attempt to organize Items in any way. 
Post-experimental interviews revealed indeed that 
very few subjects had thought that they might be 
asked to recall the words they were reading in the 
original reading task. Mostofthem said they 
thought the experimenter was j-.cerested in how wel! 
they could read, how fast they could read or how 
sinned or consistently they could pronounce the 
words. 


Although we did not give an immediate recall test 
to the subjects at the end of the preliminary reading 
task, it is extremely unlikely that they would not 
have remembered any words thatthey had seen. 
This, this experiment does not provide any evidence 
against incidental learning measured in a single re- 
call test following a reading task ofthe kind we used. 
ft only demonstrates that directed memorization un- 
der the conditions of free recall 1g not facilitated by 
whatever prior incidental learal:g has xccurred, 
This is not a surprising result, if we assume that 
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no organization .ccurs during the reading task, that 
incidental memory of item3 read, therefore, would 

involve individual items as S-units, and thatthe sub- 
ject can only recall a constant limited number of S- 

units on any given trial in free recall. If the subject, 
on the first trial in the directed learning task, re- 
cails some of the items he learned Iincldentally, he 

could not recall too many other items because his 
limited retrieval capacity wouid already be partially 
exhausted. One of the implications of these findings 
is that if the subject, before the presentation of 
a longer list for directed recall, were told what sume 
of the items in the list are, his recall would be no 
greater than that of the subject who has no such prior 
information, provided the iterms:.re not meaningfully 
related to ose ancther and that (+e rate of presenta- 
tion is rather fast. The hypotheses that increased 

recall can occur only as a consequence of organiza- 
tion and that the relrieval capacity is limited toa 
fixed rum:cr of S-units would completely aczountfor 
this tircing, aven though it could not be readily pre- 
dicted from many other theoretical pclats of view. 


ALPHABETICAL ORGAN!ZA/ION 


Th: second typ? of more direct tesi of the rela- 
tirn between Jearning and organization, as I said, tw- 
volyzs mantpulatlon of organizing strategies through 
instructions to subjects. An initial study of this kind 
was done as a Classroom experim nt (Tulving, 1962b) 
The subjects were elgtty univers'ty students. They 
had ts learn a list uf iwetry-iwvo nouns, each begin- 
ning with a different letter, and the whole set cover- 
ing wide range of Thorndike-Lorge (1944) frequen- 
cles. '™ the input phase of each trial, words were 
projected en a screen at the rate of 1, 5 second/word. 
In each output pnase of 90 seconds duration subjects 
wrote down as many words as they remembered. 


At the beginning of the experiment, ail subjects 
were given typical free-recall instructions. Four the 
first three trials all subjects worked under these 
identical instruct’ons. Before the fourthtrial, 
subjects were asked to open and read additional in- 
structicas on folded shects handed out to them before 
the experiment. For half the subjects, the iratruc- 
tiors simply reiterated wh: t all subjects had becn 
told at the beginning of the experiment, namely to 
“do your very best on ea:h recall trial and put down 
as many words from the list as youcan.”’ The in- 
structions for the other half of the subjects read: 
‘(Try tu organize your recalled words alphabetically. 
When you took at the words on the screen, note the'r 
first letters, and make an attempt to associate the 
word with the letter. When you write the words 
down, go through the letters of the alphabet one at 
a time and try to remember the word that goes with 
each letter.’’ Subjects in each group, the Standard 
Group and the Alphabetical Group, were given 30 
seconds to read these additional instructions. The 
experiment was then continued under otherwise iden- 
tical conditions for elght more trials. 


The learning curves for the two groupsare shown 
in Figure 2, For the first three trials, when both 
groups worked under identical standard instructions, 
the curves are almost Indistinguishable indicating no 
differences in learning ‘‘ability’’ of the two groups. 


FIGURE 2, Learning curves for two groups of sub- 
jects. After Trial 3, one group was given instruc- 
tions to recall the weida alpnabeticakly, while the 
other group continued learving undor standard in~ 
structions, 
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From Trial 49 on, however, the curves draw rrpidly 
apart, the raean nimber of words recalled by the 
Alphabetical Group on Trial 5 equaling that of the 
Standard Group on the Jast trial of the exper!ment, 
Trial 11. Judging by the shape of the curve of the 
Standard Group, it appears that it would have taken 
them many additional trials to reachthe level of per- 
formance comparable to that reached by the Alpha- 
betical Group on Trial 6, The differences between 
the two groups would undoubtedly be even greater if 
it were nox fo; the artificial Limit on the perform- 
ance of the Alphabetical subjects imposed by the 
“celling effect.’’ 


These results clearly is dicate that methodsof or- 
ganization are very imporiant indeter mining the 
course of memorization of a list of items. Alpha- 
betical organization {s apparently much more effec- 
tive in this type of task than are other methods of 
organization - grouping of wordsby their meaning :- 
used by the subjects in the Standard Croup. The 
learning curve of the subjects in the StandardGroup 
reflecis their limited performance, but the limit is 
rat woolly deterriined by their inacequate ranemonic 
ability. To a large extent, {t 1s determined by their 
ignorance as to how to make best use of their mne- 
monic ability in this type of task. When subjects 
are given more powerful organizing instructions, 
their ‘‘ability’’ increases considerably. 
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One important implication of this observation - 
lam now golng to digress somewhat from my main 
theme — has to do with the problemof Individual dif- 
ferences Ir. learning ability. It is commonplace to 
study individual differences in learning ability by 
dividing subjects into ‘‘fast’’ and ‘‘stow’’ learners 
on the basis of their performance ina learning task, 
and then look for similar differences retween the 
twu groups In various other situations, such as var- 
ious psychometric tests. Inthe experiment Ihave just 
described, there were pronounced differences in the 
memorization performance between the subj2cts in 
two groups, but since the groups were selected ran- 
domly it is a foregone conclusion that they would 
have shown no differences on any other tests. How 
frequently are individual differences in learning 
‘ability’? determined by the same factors as those 
manipulated in the present experiment? The long 
history of failures to find powerful psychometric cor- 
relates of learning performance, or sizeable corre- 
lations betwren different learning tasks, suggests 
that Individual differences In learning ‘‘ability’’ may 
be largely governed by individuals’ knowledge of ef- 
fective sirategies of handling a particular task, rath- 
er than by the sheer goodness of their memory. At 
any rate, in the light of data fromthisexperiment it 
seems that if we wish to add to our understanding of 
Individual differences in learning ‘‘ability,’’ a good 
place t start is tc analyze the learners’ strategies 
of memorizing in a given learning situation, and not 
to observe his behavior in some other extra-exper!- 
mental) situation. 


ORGANIZATION AND LEARNING 


Let me new return to ine relation between organ- 
lzatton and ‘carning., Y/e have seen that when a sub- 
ject kas to memorize a list of randomly selected 
words, alpbatetical organization {s more effective 
than other methods of organizatio.. Alphabeticalor- 
gar.zation Changes the task into a kind of paired as- 
sociate learning task. The initlalletter of each 
word se. ves ue a Cue for the recaliofthe whole word 
The experime-tcr does not have to present these 
cues since ar articulate subject can generate them 
on his own. We could say that in alphabetical organ- 
ization each input word is cued with respect to its 
initlal letter c::d that its rctrieval is facilitated by 
the availability of relevant cues. When other meth- 
ods of organization are used, such a3 grouping of 
items in terras of their assculative meaning, their 
belongingnees ? to eurerordinate conceptual catego- 
ries, or the degree o. the'r prior fami.farity, Input 
words are cued with respect to their properties oth- 
er than the initia} letter and their retrieval is pre- 
sumably effected through these other cues. it Is pos- 
sible, of course, that a given word Is cud in sev- 
eral ways and that the way it {s cned changes in the 
course of the experiment, but under the usual time 
pressure ina typical experimert, multiple cueing is 
probably an exception rathez tana rule. 


Suppose now that a subject has been exposed to a 
set of kte.ns for a number of trials, that he has not 
discovered alphabetical method of organization, and 
tiat he has been cusing the words in terms of their 
other characterlstics. What would happen, if the 
subject were now told to switza to another method 
of organization, say alphabetical organization? We 
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know already that alphabetical organization is likely 
to be rnore effective than other methods of organiza- 
tlon and that therefore alerting the subject to It 
should facilitate learning. But it 1s also possible 
that changing the method of organization requires not 
only the adoption of the new strategy, but also ihe 
suppression of the previously used strategy. One 
might expect, therefurc, that immediately afler the 
introduction of alphabetical instructions the eff i- 
ciency of the storing and retrieval mechanisms 
iz temporarily reduced and that the disturbance {s 
the greater the more highly developed the non-alpha- 
betical organtzation. 


Data relevant to these hypotheses come from an 
experiment done by Marcia Ozier as partofher PaD 
thesis (Ozler, 1965). Her subjects learneda list of 
twenty-two words, each beginning with a different 
lelter, Words were projected on a screen at the 
rate of 1,5 second/wordand subjects recorded their 
recall on paper- pullers that prevented them from 
seeing more than one word of their recall at any 
time. The duration of output phase of eachtrialwas 
90 seconds. 


Most subjects were initially given standard free- 
recall instructions and then switched over to alpha- 
betical instructions at some point in the experimen- 
tal sequence. The two Independent variables in the 
experiment were, first, the ordinal number of the 
‘critical’ trial on which alphabetical instructions 
were given, and second, pre-input versus pos t-in- 
put alphabetical instructions, Different grou ps of 
subjects were c¢iven alphabetical instructions on Tri- 
als 1, 5, 9, 16, and 21. In each of these groups, 
half the subjects were given alphabetical inst ruc- 
tions before the input phase of the critical trial, 
while the other half received these instructions after 
the Input phase, that is, before the output phase, of 
the critical trial. Before the critical trial, subjects 
in a given group worked under standard free-recall 
instructions. Thus, for instance, one group of sub- 
jects worked under free-recall instructionsfor eight 
trials, then received alphabetical instructions, fol- 
lowed by the input and »utput phases of the ninth and 
subsequent trials. Another groupworked under 
standard free-recali instructions for eight trials, 
was then shown the words in the input phase of the 
ninth trial, and then was asked to start recalling 
words in the alphabetical order, beginning vith the 
immediately following output phase. There was thus 
a total of ten independent groups, with twelve sub- 
jects per group. Scoring was lenient; even if the 
subject had deviated somewhat fromthe alphabetical 
order when he was supposed to recall the words al- 
phabetically, he was given credit for each word cor~ 
rectly recalled. Subjects who obviously did not fol- 
low alphabetical instructions, however, were re- 
placed, 


The somewhat schematized results of this exper- 
iment are stown in Figure 3. The upper heavy 
smoothed curve shows the learning curve for the 
subjects who received alphabetical instructions be- 
fore Trial 1, the lower heavy smoothed curve rep- 
resents the free-recall conditions. Subjects who 
had received pre-input alphabetical instructions on 
Trial 1 had a mean recall of approximately eight 
words on that trial, while those who had received 
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FIGURE 3. The effect of alphabetical organizing 
instructions given at various points inthe course of 
learning. See text for explanation. 
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post-input alphabetical instructions on Trial 1 re- 
called approximately five words, a difference of 
three words. The learning curve for the latter group 
is not shown..nthe graph. It reached the learning 
curve of the former group by the fifth trial, being 
practically identical with it thereafter. 


The other data In Figure 3 show the initial drop 
and subsequent rapid recovery in recall of groups 
who were given alpliabetical instructions at Trials 
5, 9, 16, and 21. For each of these groups, with 
the excepiion of those for whom Trial 21 was the 
critical tria), mean recall scores are shownfor five 
trials after the critical trial. Thess data show, 
first, that Immediately after the introduction of al- 
phabetical instructions there is a drop!in perform- 
ance ~ with the exception of pre-input instructions 
on Trial 5 - with the magnitude of the drop varying 
directly with the ordinal number of the critical trial 
and being consistently greater for post-input alpha- 
betical Instructions, and second, thatthe subsequent 
recovery of the effectiveness of alphabetical instruc- 
tions given onthe critical trial varies inversely 
with the ordinal number eZ the critical trial. 


The percentage loss in recall in the first output 
phase following the Introduction of alphabetical in- 
structions {s plotted as a function of the ordinal num- 
ber of the critical trial, for both pre-input and post- 
input Instructions, in Figure 4. Each data point in 
this graph represents the mean difference in recall 
between the number of words recalledonthecritical 
tr{al and the immediately preceding trial divided by 
the mean number of words recalled onthe !mmediate 
pre-critical trial. The data plottedin Figure 3 
showed that the drop in gerformance after the Intro- 
duction of alphabetical instructions, measured in 
terms of absolute number of items, varled directly 
with the ordinal number of the criticaltrial. The 
data shown in Figure 4 indicate that the same rela- 
tion holds between percentage foss in recall and the 
ordinal number of the critical trial. 


From previous experiments we already know that 
organization of material increasesover trialsot 
practice in the free-recall situation (Bousfield, Puft, 
and Cowan, 1964; Ehrlich, 1965; Tulving, 1962a, 
1964). Therefore, manipulating the temporal point 
at which subjects are switched from other forms of 
organization to alphabetical organizationessentially 
amounts to manipulation of the degree of existing or- 
ganization that has to be changed. The results of 
Ozier’s experiment suggest that the stronger the 
pre-existing organization, that is, the more firmly 
the list-items are cued with respect to characteris- 
tics of words other than their initial letters, the 
mere disruptive is the requirement that the subject 
change his system of cueing and the longer it takes 
for the otherwise powerful alphabetical system of 
organization to become effective. 


AVAILABILITY AND ACCESSIBILITY 
OF STORED INFORMATION 


I have s0 far talked about two general classes of 
nethods of organization: organization of words Into 
lurger groups in terms of their perceived, discov- 
exed, or fabricated meaningful relations to one an- 
other; and organization interms of structural 
features ot words, such as initial letters. In either 
case it is as if words stored in memory — or infor- 
mation about words to be reproduced ~ are in stor- 
age in a way that would facilitate retrieval: two or 
more related words are stored in or near the same 
locaticn, suchthat when the retrieval mechanism 
finds one, the other cne is also easily located, or 
else a word is stored in a location inwhich its initial 
letter js stored. Thus, one part of the stored in- 
formation can be thought of as a retrieval cue for an- 
other part. Organization of information in the stor- 
age, howe ‘er, Can facilitate retrieval only to the ex- 
te ¢ that retrieval cues are available at the time of 
recall. Alphabetical organization is more effective 
than organization of items interms of their semantic 


FIGURE 4, Percentage lors of recallon the trial 
immediately following the introduction of alphabet- 
ical organizing Instructions, as a function of the 
“critical’”’ trial on which alphabetical instructions 
were given. 
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features because the initial letters of the words, 
serving as retrieval cues are readily availiable tothe 
subject at the time of recall. 


This kind of speculation implies that organization 
of material in the memory storage, or organized 
retention, does not necessarily increase the storage 
capacity, but rather makes the stored information 
more accessible to recall by providing distinctive 
retrleval cues through which individual items of in- 
formation can be reached. It also implies that the 
amount of information potentially available in the 
storage at a given time may be greater than is ap- 
parent in typical unaided recall. Inother words, 
Imitation of memory ts primarily determined by the 
limited capacity of the retrieval mechanism and not 
necessarily by the limited capacity of the storage 
mechanism. 


tn experiments of the kind that we have examined 
so far it is impossible to distinguish between reten- 
tlon and recall. If a subjectusing alphabetical or- 
ganization can recall more words than an otherwise 
comparable subject who uses less efficient methods, 
we do not know whether this difference is attributa- 
ble to differences in retention or only in recall. It 
is possible that both subjects have retained the same 
number of words and that the alphabetical organizer 
simply has access to a larger number of retained 
words, but it is also possible that the alphabetical 
organizer in fact has been abie to store more infor- 
mation in his memory, that therefore more Informa- 
tion is available in the storage, and that his superi- 
or recall merely reflects the greater amount of in- 
formation that he has stored. 


The logical requirements for the analytical sepa- 
ration of retention and recall, or the distirction be- 
tween availability and accessibility of stored mate- 
rial, are simple enough. All that we need todo Is to 
presert the material to be remembered to different 
subjects under identical conditions, including iden- 
tical instructions, and then vary experlmentally the 
nuraber of retrieval cues at the time of revall. If 
the groups are treated ideni‘cally upte the beginning 
of the recall test, we can assume that the amount of 
information they have stored and ‘hus the 2mount of 
information available {s the same for all groups. if 
the number and kinds of retrieval cues giver: to dif- 
ferent groups at the tirae of recall produce differ- 
ences In recall, thes differences would reflect dif- 
ferences in accessibility of the stored information 
and not differences in availability. 


in the initial experfment we dia to distinguish be- 
tween availability and accessibidty (Tulving and 
Pearlstone, 1968), we used a dual-Jevel Input list, 
consisting of category names and appropriate words 
as instar:es of these categories. Thus, for instance, 
one of the lists consisted cf twe aty -four words in 
twelve categories, with two words per category. The 
list presented to subjects might contain items like 
this: things found on a farm -WHEAT, TRACTOR; 
Substances for flavoring food - SUGAR, CLOVES; 
geological formations ~ PLAIN, LAKE; musical in- 
struments - DRUM, FLUT#; etc. Subjects were in- 
structed that their task was to remember as many 
words as possible, that they would be tested for the 


words only, and that they did not have tu memorize 
the category names. Ali subjects learning a partic- 
ular list were treated identically up to the beginning 
of the recalitest. Atthat point, half the subjects 
were asked to recall ali the words they remembered, 


i.e, words other than the category names, while 
the other half were presented with the category 
names as retrieval cues and asked towrite down all 
the words belonging to each category that they re- 
membered from the list, 


The de sign of the experiment included lists of 
three different lengths (twelve, twenty-four, and 
forty-eight words! and three levels of numbers of 
words per category (one, two, andfour). Within 
each of these nine conditions of presentation, there 
were then two conditlons of recall, cued and non- 
cued, as I have just described. The exper!ment was 
done with high-school students of both sexes as sub- 
jects, and data were collected in regular class ses- 
sions. Input material (category names and words 
to be remembered) was presented Ly means of tape 
recorder. The subjects wrote their recall in appro- 
priately designed booklets. The presentation tima 
varied with the length of the list and with the number 
of categories according to the formula: T= NoC+L, 
where T is presentation time in secords, NoC 1s the 
number of categories, and Lis listlength. The 
amount of time given for recali was 1, 2,and4 min- 
utes for lists of twelve, twenty-four, and forty-eight 
words, respectively. A total of 949 subjects was 
tested, with approximately fifty-three subjects for 
each of the eighteen conditions of the experiment. 


The mean number of words correctly recalled 
under each of the conditions of the experiment is 
shown in Table 1, together with corresponding 
standard deviations. As these data show, cued re- 
call was superior to non-cued recall for all nine 
lists, the superiority varying directly with list 
length and inversely with the number of words per 
category. The difference between cued and non-cued 
recall thus was smaliest for the list in which twelve 
words were organized into three categories, with 
four words per category. In this case, presentation 
of categary ames ae retrievalcues apparently does 
not help subjects very much since they presumably 
can remember che category names ontheir ovn. 
The largest difference was found for the 48- word 
list in which each word belonged to 4 different cate- 
gory. Presentation of category names as retrieval 
cues in this list facititated recatl considerably: sub- 
jects in the cued recall group recalled over thirty- 
{ive words on the average, v:hile the subjects in the 
non-cued group recalled less than sixteen words. 


The najor implication of the results of this ex- 
periment is that the subject’s failure torecall a 
word he was instructed to recall does not necessar- 
ily mean that information about the membership of 
the word in the list is no more available inthe mem- 
ory storage. It is availab’s, but not accessible un- 
der the typical unatled recall cenditions. Mf the rub- 
Ject receives cues aiout the ‘‘location’’ of the rele- 
vant information in the storage, he will ‘find’? many 
otherwise inaccessibie words. Thus, intratrial “for- 
getting” (Tulving, 1964) of at least some of the items 
does not reflect the failure of the storage mechanism, 
but only the fallure of the retrieval mechanism. How 
does the retrieval mechanism operate? 
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TABLE 1 


MEAN NUMBER OF WORDS RECALLED AND THEIR STANDARD DEVIATIONS FOR THE EIGHTEEN 


EXPERIMENTAL CONDITIONS 


Number of Words Per Category 


List Recall 1 2 4 

ee acca s. D. M Ss. D. M Ss. D 
Cued 19. 70 1.57 10. 94 1,12 9. 98 1.55 

7 Non-cued 7.70 1.61 8.13 2, 03 9.33 1.91 
Cued 21.70 1,97 19. 31 2.38 15.11 3.17 

7 Non-cued 11.18 2.56 11. 82 2.54 13. 38 3,08 
Cued 35. 35 6,42 35. 76 7.86 29. 60 6.00 

ee Non-cued 15.57 3.53 18. 79 5, 99 19, 33 5.34 


The Tutving and Pear)stone {1966) experiment pro- 


vides some data relevant tothis question. Word-re 
call data in an experiment of this type, where words 
are organized into higher-order units by the experi- 
menter ~ in this case, into superordinate cate go- 
rles — and where this organizationis adopted by the 
subject, car be analyzed into two indegendent multl- 
plicative components, numter of categories recalled 
and number of words recalled per recalled category 
(cf, Cohen, 1963, 1966). A category is said ‘s be 
recalled ~ to be accessible ~ if at least one word 
from that category 1s recalled. Given the number 
of totat words recalled and the number of categories 
recalled, the mean number of words recalled within 
recalled categories can be Obtained simply by divid- 
ing the former number by the iatter. For Instance, 
if the subject recalls the words SUGAR, CLOVES, 
and LAKE, he has recalled two categories - Sub- 
stances for flavoring food and geological forma- 
tlons - and an average of 1.5 words per category, 
two words from one category, and one fromthe 
other. 


The breakdown of the word-recall data into these 
two components revealed two interesting facts, 
First, presentation of category names asa retrieval 
cues affected only the number of categorles recalled. 
In all lists the mean number of words recalled with- 
Ina recalled category was the same under the cued 
and non-cued recall conditions. Second, word-re- 
call increased as a direct function of list length for 
both cued and non-cued recall conditions, but again 
this increase was attributable primarily to the in- 
crease in the number of recalled categeries and not 
‘o the increase in the number of words recalled per 
category. For the 24-word and 48-word lists the 
number of words recalled per category vas Invari- 
ant. 


These data suggest then that recellof wordsfroam 
accessible categories is Independent of the number 


of categories recalled, regardless of whether differ- 
ences in category recall are brought about through 
presentation of category names as retrievalcues or 
through increasing the Ust length and thus the total 
number of categories presented. Retrieval mechan- 
ism seems to operate in some sense independently 
at two levele: at the level of higher-order units of 
organization and at the level of individualitems with- 
in these higher-order units. Limitattonof recall is 
deter mined by limitation of retrieval at both levels, 


A further demonstration of the relation between 
number of categories and recall is provided by an- 
other experiment of Ozier’s (1965). In this exper|- 
ment subjects learned lists of twenty-four words 
either under conditions of free recall or under con- 
ditions of alphabetical organization. For different 
groups of subjects the number of unique inittal let- 
ters of words in the list was varied. For one group, 
all words began with different letters, For another 
group there were twelve pairsof words (words with- 
{n each pair beginning with the same letter);for a 
third group, eight initial letters were used, each 
associated with three different words, and 60 on, to 
the group in which twelve words began with one let- 
ter and twelve words with another. Thus, the ex- 
periment can be thought of as an analogy to the Tul- 
ving and Fearlstone experiment, with st length 
held constant at twenty-four words, the number of 
categories {initial letters of words) varylng over the 
range of two to twenty-four, andthe number of 
words per category (words sharing the initia} letter) 
varying correspondingly over a range of twelve to 
one. Ozier’s experinuaot differed from the Tulving 
and Pearlstone experiment in that it was a multi- 
trial learning experiment. Each subject was given 
twenty trials of practice on the list to which he had 
been assigned. The order of words was randomized 
on all trials, the words were projected on a screen 
at the rate of one word/second, and subjects had 95 
seconds for written recall on each trial. Under the 
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FIGURE 5, Mean recall on successive Diocks of 
four trials for lists varying in number of difierent 
initial letters and learned under alphabetical organ- 
izing instructions (A), and for a list learned under 
free-recall instructions (FR). In the designation of 
A lists, the first figure refers to the number of dif- 
ferent initial letters of words, and the second rep- 
resents the number of words beginning with a com- 
mon letter. 
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BLOCKS OF FOUR TRIALS 


conditions of alphabetical recall, initial Letters of 
the words were given as retrieval cues in the output 
phase. Subjects were premedical students, mostly 
men, with twelve subjects per group. 


On the first trial, there were no systematic dif- 
ferences in the number of words recalled by differ- 
ent groups, and only after the first three trials did 
differences become noticeable. This suggests that 
the presentation rate of 1 second/word was too fast 
for words to be cued with respecttotheir initial let- 
ters. The learning curves for four alphabetical 
groups and a free-recall group are shown In Figure 
5. The mean number of words recalled is ploftedin 
Figure 5 against five blocks of four (rials each ona 
logarithmic scale. These curves show that learning 
varied directly with the number of categories (num- 
ber of unique initial letters) or inversely with the 
number of words per category. It is also interest- 
ing to note that free recall is more efficient than al- 
phabetical recall of the list in which there are only 
two categories and twelve words per category. 


The results of the last two experiments suggest 
that under conditions where the subject is provided 
with efficient retrieval cues - or where he can eas- 
ily generate them from his own memory- and where 
the inter-item associative strength of items within 
a category is minimal, the optimum strategy Is to 
organize the items into a maximum number of cate- 


gories. On the other hand, under conditions where 
the subject can benefit from organization of individ- 
ual items into higher-order units only to the extent 
that he himself remembers whatthese higher-order 
units are, the optimum strategy is toorganize items 
into relatively few categories. It is most likely, how- 
ever, that when the number of categories is de- 
creased beyond a critical Nmit the difficully of re- 
trieval of items from withina gtven category will 
outwigh ihe facilitating effects of smaller nuraber 
of categories, and recall will decrease. In the Hm- 
iting case where all {tems ina list belong toa single 
category, recall is no better than recall of a list in 
which each item belongs to a different category. 


SUMMARY 


I have argued that understanding of many phenom- 
ena of verbal learning and memory would be en- 
hanced if we adopted the basic orlenting attitude that 
a person’s mnemonic performance depends toavery 
large extent or the methods that he wittingly or un- 
wittingly uses to organize the materiai. The impor- 
tant function of such orgun!zation Is to facilitate re- 
trieval of information from the memory storage. 


I considered in some detail the problem ofthe ef- 
fect of repetition on recall of a set of discrete items. 
Mere mechanical repetition of items does not seem 
to have any noticeable effect onthe subsequent 
directed memorization of these {tems, provided that 
individual items as such ere already well known to 
the subject before the experiment. Learning of the 
set, however, can be considerably speeded up if the 
Subject uses effective methods of organizing the ma- 
terial. Individual differences among subjects in 
various learning tasks may reflect primarily their 
knowledge of, and the ability to utilize effective 
strategies and mediational devices, and only second- 
arlily their innate differences {n memortzing ability. 


Different methods of organizing material may 
be incompatible with one another. When the subject 
has been using one method and then is asked to ap- 
ply some other method to the material he is memo- 
rizing, the adjustment to the new method requires 
some time. Interference with overt recall under 
these conditions reflects incompatibility of different 
types of organization, and adds further support to 
the hy pothesis that learning is critically dependent 
upon how the material to be remembered is organ- 
ized. 


It is not necessary to assume that organization 
changes the amount of material that the subject can 
retain, or the amount of information potentially 
available in the memory storage. Evidence sug- 
gests that organization only serves to make more 
of the avatlable informationaccessibte. The learn- 
er has always more mnemonic Information avail- 
able, relevant to the successful accomplishment of 
a memory task, than he can ordinarily make acces- 
sible to recall. Accessibility of information de- 
pends not only on {ts availability in the storage, but 
also on retrieval cues. Retrieval cues may be part 
of the environmental conditions prevailing at the 
time of recall, or they may have to be carrted in 
memory. Limitation of the retrieval mechanism 
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thus seems to be determinéd by the lack of accessi- 
bility of efficlent retrieval cues, and the functional 
significance of organization lies in its role of pro- 
viding such retrieval cues, 


Optimum organizatlon depends on the requlre- 
ments of the recall task. If retrieval cues have to 
be generated from memory, the materlal ls best or- 
ganized into a relatively small number of catego- 
ries — Mandler (1967) suggests that thls number 
for common words is approximately five - if,on the 
other hand they will be available inthe perceptual 
environment at the tlme of recall, the nuinber of 
categorles should be as large as possible. Retrleyv- 
al cues such as category names provide access to 
categorles or other kinds of higher-order units of 
material, but once accessto such higher-order units 
becomes possible, retrieval of individual elements 
within units is unaffected by the number of higher- 
order units already recailed or yet to be recalled. 


The evidence on which this account has beenbased 
ls admittedly rather fragmentary, but the initial re- 
sults are quite encouraging. Certain consistencles 
have already become apparent and further work will 
probably clarify those aspects of the conceptual 
framework that are still obscure. 


While all this research that I have discussed was 
not undertaken with a vlew to solving practical prob 
lems as they occur in learning andremembering 
in real-life educational settings, It does have some 
Implications for these problems. I will review just 
one, fully reallzing that it is slmply a reiteration of 
what many people have sald before. 


The kinds of findings from the simple experi- 
ments I have described in this paper cnce more un- 
derscore the need for the examination of methods 
that learners in classrooms use when they acquire 
knowledge and skills. We cannever be certain that 
the methods of learning a person uSes are the opti- 
mum ones for the requirements of any given task, 
or that these methods are sufficlently flexibte to fit 
all tasks which in fact do require different strate- 
gies. And at the present time, we probably could 
not even evaluate the appropriateness of different 
approaches to different tasks or different subject 
matters, since we know s0 llttle about which meth- 
ods are optlmal for which kinds of learners {n which 
situations. It seems to me that educators and psy- 
chologists have been more interested in methods of 
teaching than ln methods of learning. Teachers are 
frequently taught how to teach, but how often are 
learners given specialized instruction In how to 
learn? A good teacher may be successful because, 
among other things, he organizes the material to be 
learned for the learner, but a good learner is Itkely 
to be more successful because he can organize the 
material on his own even if lt is not optimally struc- 
tured by the external environment. 


To the extent that methods of teaching and meth- 
ods of learning can be separated, it would seem that 
in the final analysis the latter are more important 
than the former, if for no other reason then at least 
because it might have greater transfer value as far 
as the individuat learner is concerned. Even a poor 
learner, one who does not know how touse his Innate 
intellectual abilities most effectively in learning sit- 


uations, can do better if he has a good teacher to or- 
ganize the matertal for him, but he cannot always 
expect to have good teachers around him. In many 
situations he has to be his own teacher. Would it 
be too rash to suggest that instruction In how to learn 
and how to remember be as important a part In the 
curriculum of the schools of tomorrow as are the 
three R’s now? 


FOOTNOTE 


1, Research reported in this paper hasbeen sup- 
ported by Grant No. APT-39 from the Nation- 
al Research Council of Canada, and Grant No. 
GB-3710 from the National Science Foundation, 
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ama Developmental Processes 


in Thought 


WHEN Professor Kiausmeler chose 
the title for my paper, he asked me iodeal with 
three points. First, give an outline of the concep- 
tual framework that 1 am going touse to Indicate de- 
velopmental processes in thought. Second, give 
come account of the research that has been carried 
ou. to test the validity of the generalframework. 
Third, point out the educational implications of what 
is dealt with in the first part of the paper. 


The treatment of intellectual processes, includ- 
ing thought, is rather different inAmerican psychol- 
ogy from that in either Russianor Swiss psychology. 
Only the future can show the extent to which these 
treatments can enrich one another, or the extent to 
which the different approaches say (he same thing 
using different terminologies. Individuals wishing 
to know more of these three approaches would, no 
doubt, be interested in Berlyne’s most recent book 
Structure and Direction in Thinking (1965). However, 
T shall deal with my topic largely from the stard> 
point of the Genevan school, for Piaget has great in- 
fluence in British educational circles, although he 
is not quite 90 influential among British psyc hol- 
ogists. 


FIRST 21 MONTHS OF CHILD'S LIFE 


There is now much data whkh indicates thal the 
first 21 months or 80 of a child's ite are of great 
importance from the point of riew of the growth of 
thought. Piaget has shown that a baby’s morements 
are not random; indeed, on close inspection they are 
seen to conform to a pattern. This period of devel- 
upment was Called by Piaget the period of sensori- 
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motor intelligence, because the schemas, that i¢ the 
sequence and the structure of the actions stowly 
built upin the mind, are dependent upon the cirect 
support of perception and motor activity. From 
12 to 18 months of age the cl.) goes Uhroughape- 
riod of intense experimentation. He will let an ob- 
ject fall to the floor to see what happens; he will 
knock things, shake them, or throw them to se” if 
they roll. New ways of doing things are discovered 
based on a grasp of rew relationst'ps. For example, 
a child will pull a box toward him in order to obtain 
a toy placed on it, which otherwise would be out of 
reach. And between 18 and 21 months of age, the 
awareness of relationships is sufficiently developed 
for the child to be able to invent new means, and to 
be able to foresee which acts will succeed and which 
will not, without putting them to thetest. This in- 
vention comes through a covert process that amounts 
to internal experimentation. The earliertrial and 
error period is nol now 60 important, for the child 
can increasingty represent to himself the various 
Possible actions and how they must be combined, to 
attain a desired end, The child is beginning tothink, 
for his actions are now carried out in an inward form. 
Some psycholoyiz.s would call such internalized ac- 
tho 8, incipient or implicit responses. 


Dur ing the first 21 months of poof life, the ordi- 
nary child elaborates the basic ectemas cf the ob- 
fect, of apace, of time, and of cautality. For ex: 
ample, the basket schemas in relation to space and 
time are laid down as when the chikd adjusts his 
reaching actions for near and distant objects, ard 
wher he moves to catch a swinging rattle. 


oy 
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In Piagets’s view, the child in adapting himsclf 
to his environment has to assimilate or absorb new 
experiences into his existing schemas. Atthe same 
time he must accommodate to the environment 
through the modification of existing schemas or the 
build up of new ones. Cognitive adaptation to some 
new situation, and hence the ability to deal with it 
in thought, involves both these processes. To as- 
sim'late the meaning of a new situationthe child 
must accommodate to Jt; and In order to accommo: 
date to it, he must be able to assimilate it. Cogni- 
tive growth is thus a step Ly step process with the 
new always building on the old. But once new ex- 
perlence is assimilated, the child’s schemas be- 
come more complex, and because of this, mo:ecom- 
plex accommodations are possible. Moreover, the 
child's schemas do not remain unchanged even in the 
absence of ervironmental stimulation, for meanings 
are constantly reorganized, and linked with other 
meanings. This internal renovation is, in Piaget's 
view, an important source of cognitive development. 
Even so, intellectual growth is slow. We must also 
note that Plaget’s observations lead him to believe 
that it 18 schemas in the proces3of organization that 
children tend to repeat playfully and with seeming 
pleasure. But when such schemas have become or- 
ganized, the apparent pleasure disappears and they 
cease to be repeated unless they are combined to 
forma new schemas or serve as & means to some end. 
Flavell (1963) remarks that schemasare structures, 
and one of their imporiant, bull 11 properties, is 
that of repeated assimilation of anything. similable 
in the environment. 


BETWEEN 2 AND 6 YEARS OF AGE 


Throughout the sensorl- motor period the child is 
unable to use an image or word, which could repre- 
sent to him an object or event not actually pregent. 
For Piaget, the child moves out of this stage into 
what he calls the pre-operational stage of thought 
when the child can differentiate a word from what it 
stands for; for example, use the sound ‘‘dog'’t 
stand for, or represent, adog. Whenhecan do this 
he can represent to himself situations that are no 
longer in actual evidence, and thought is lifted toan 
entirely new level. Note carefully, however, that 
thought comes before language; the latter is fitted on 
to thought that already exists. But once the child 
can use language, thought is extended over an itn: 
mensely increased range. Moreover, he now has a 
more permanent and far more flexible model of the 
outside work’, for he Is no longer dependent upon 
immediate perception and motor activity for thought. 
Nevertheless, between 2and dor Syears of age, 
thinking tends to center on one striking fealure of 
the aituation; it la algo icreversible in that the child 
is unadle to move back, In his mind, to the starting 
point from which his immediate thinking began. The 
cNH at this slage can only see anevert from his 
own viewpoint; he ls unable to conceive the view point 
of other children. Yet by Jor dyears of age the 
child has copied the adult model of language, and at 
this age we are in grave danger of overestimating 
his level of thought from the natare of his speech. 


By about § years of age a change begins to set ir, 
and by 7 to 8 years of ace the chiki’s (hinking be- 
comes more systematired; that is, his thoughts now 
corform to certain rules and hia thinking becomes 


what we adults call logical. The sequence and struc- 
ture of actions In the mind, or the schemas, now 
available are now altogether different inkind. The 
abllity to reason and ‘‘understand’’ demands higher 
order schemas which permit a simultaneous grasp 
of the successive sequences of actions taking place 
inthe mind. The ordinary child of 7 to 8 years can, 
as it were, ‘look down o1 his schemas” or ''turn 
round on his schemas.” He is then aware of the se- 
quences of action In his mind; he can see the part 
played by himself In ordering his expertences; and 
for any action in his mind, he can seethatthere are 
other actions that give the same result. That is, he 
sees equivalences. Thus he understands that 4+2« 
343 =7- lor that all girls plus all boys plus all 
adults = all boys plus al) adults plus allgiriae. In- 
deed, there is now anew kind of coordination of 
schemas, ylelding a simulataneous understanding of 
equivalences for actions within the mind. Thus the 
child can now measure the same distance infeet and 
Inches ard understand that the different figures 
mean the same thing; he can perform subtraction us- 
ing the method of complementary atdition; he can 
decompose 42 units in 4 tens and 2 units with under- 
standing. Thinking now conforms to a system, and 
there is learning with a certain amount of understand- 


ing. 


At the level of sensorl+ motor and pre-operationat! 
thought there was a great deal of learning, but little 
or no understand'ng ‘a the sense that the child 
Yearned a linear sequence of action# but was unable 
to elaborate a set of equivalences. We must not In 
any way belittle learning that takes place before 
thought becomes systematic, for such learning is es- 
sential for the growth of thought itself. Indeed in 
oler normal children, and in adults, a greatdeal 
of learning is of this type. 


Now because the elementary-school child can In- 
creasingly see the part played by himself in order- 
ing his experiences, ard because he canincreasing- 
ly coordinate actions in his mind and make themcon- 
form to a system, he can build the concepts of a 
class, a series, length, time, and soon. But the 
concepts that he buikis are only those that he 
can attain from experience with first 28nd reality, 
and his systematized or logical thought is related 
only to the world of perceivable things and evenia. 
For Piaget, the elementary-school chiki lg at the 
elage of concrete operational thought and 18, for ex- 
ample, able to understand certain aspects of mathe- 
matics, 


END OF ELEMENTARY SCHOOL PERIOD 


Toward the end of the elementary- school period, 
however, chikiren begin to realize thatthere are 
gaps and uncertainties in their thinking, andthatcer- 
tain kinds of problems cannot be solved by them. As 
the child becomes better at organizing and structur- 
ing problem data with concrete operational methods, 
he becomes more aware that the latter does not yleld 
a logically exhaustive solution to Air problem, He 
gropes fornew methods of attack, often in Piaget's 
view, as the adolescent commits himself toreal life 
sitaations. 


So from 11 te 12 years of cge In able chlldren, 
and from 13 to 14 in ordinary pupils, aew thinking 
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skills begin to emerge. Due to his continued Inter- 
actions with the cultural milieu, and to the matura- 
tlon of the central nervous system, the individual 
can produce more complex expectations when faced 
with certain kinds of situation and data. His logical 
thought is no longer restricted as before, for hecan 
Increasingly use statements or propositions relevant 
to objects and their relations. The sequence and 
structure of his mental actions, or his schemas, 
are new in kind. The pupil can now begin to manip- 
ulate statements which refer to classes and relations. 
For example, he can answer the question ‘If Yenry 
is taller than Mary and shorter than Debbie, who Is 
the tallest?’ Or he can argue from the situation in 
front of him that, ‘Either this must be true or that 
must be true, or he can see that ‘'X implies Y.” 
The pupil can, for any sequence of actions in his 
mind, see a greater range of equivalent actions than 
was the case at elementary-school level. Faced 
with certain situations the child can, at 13or 14, set 
up an hypotheais and work out what would happen if 
this hypotheaia was (rue. He ia now able todeal 
with the merely possible. The pupil has reached 
what Piaget calls the stage of for mal operational 
thought, and many experiments to illustrate the 
growth of such thought are to be found in Inhelder 
and Piaget's (1953) book The Growth of Logical 
Thinking from Childhood to Adolescence (1058). A 
humber of these experiments were repeated by Lov- 
ell (1963) and Jacksou (1965), and the broad stagea 
in the growth of logical thinking were mainly con- 
firmed although the positicn is more complicated 
than Inhelder and Plaget auggested. It must be 
stressed, however, that forma® thought is found In 
all areas of thinking - In history, literature, poli- 
tice - and not just In eclence and technology. There 
is much published work to support thia statement, 
and if space permitted, I could give you some inter- 
a {Musirations for formal thinking Inthese 
leks, 


With the onset of formal thought, the pupil's able 
to elaborate an entirely new kind of concept. You 
will remember that in the elementary achool the 
chiké could say how he ordered his experience, for 
he could dissociate the part played by himaelf in 
Classifying his experience from the characteristica 
of that experience. But In adolescence the pupil fa 
able (o structure and coocdinale actions upon rela- 
tions, which themselves resut from the coordina- 
tlon of actions. For example,in the case of heat tn 
physics, the Concept depends on the earller elabor- 
athlon of the concepts of mass and temperature. The 
tatter are developed at the level of concrete opera- 
Clonal thought, for each Is a coordination of aome 
Inteitive aspect of reality, but their product is not. 
Concepts derived at the lerel of formal thought de- 
pend upon the concepta elaborated at the level of 
concrete thought beirg completely detached from 
thelr concrete contexts and manipulated as “pure’’ 
concepts. 


BERAVIOR THEORY 


Many individuals have been brought up on what 
toay be broadly called behavior theory, although nx. 
ali Americans think of cognitive growth in behav- 
foralterms. Some are now talking of ‘‘strategiea’’; 
“*strocture’ and ‘rule’; “programa”; “plans.” 
But for people who have studied behavior theory 1 


would like to review afew points that will help them 
grasp how the simplest principles of behaviorism 
look to a Piagetian. First, if two schemas are fre- 
quently svoked in regular succession they tend to 
form a single, larger, schema comprlsing the first 
and then the second in that order. The new and 
larger schema i8 then evoked as a whole. This Is 
“conditioning.’’ The individual action is, of course, 
the limiting case of a schema. Second, if two or 
more schemas are frequently evoked In Irregular 
succession they, too, tend to form a larger schema 
made up of all the original schemas. Tis larger 
schema will also be evoked as a whole, although the 
order of the evocation of its parts will depend upon 
the stimulus properties of the situation. Neverthe- 
less, its value, as a larger schema, lies inthe mu- 
tual inter-facilitation of its parts. This provides 
the basis for ‘irial and error’ behavior thought by 
Thorndike to be the prototype of all learning. Thira. 
if a situation evokes a larger ‘‘trial and error’’ 6ys- 
tem of actions or schema a8 indie*ted in my second 
polm, andthe larger schema includes a particular 
sub- schema that {s particularly appropriate to the 
situation, the effect of accommodation will be to in- 
hibit anc finally eliminate the other sub-sche mas 
and so strengthen the particular sub-schema (Thorn- 
dike’s Law of Effect). 


The functional principles indicated under my 
three points seem to be common to all schemas and 
show the most elementary forms of coordination of 
schemas. They may accountfor habit formation, or 
for simple kinds of learning, either in humans or in 
animals, which involve & linear sequence of sctions. 
But we do not know if they could be made to account 
for understanding, for the capacity to reason and to 
understand are not functions or properties of all 
schemas. From time to time a combination of my 
first two points may well give more ‘'intelligent’’ 
trial and error behavior from which outsiders or on- 
hookers may tafer that two separate sequences of ac- 
tons are equivalent to one another. For example, 
a young child, or an oKer retarded child runs into 
the house by the snortest route whichis the one nor- 
mally used. But if he finds the gate locked, he at 
once selects tue best alternative. Equivalence isim- 
pled by the detour behavior, but It is not explicit 
in the chiki's representation of the situation. 


WIthin these first and second order oper atioral 
achemas, l.e,, schemas that function at the level 
of concrete and formal operational thought respec- 
lively = the operational structure of systerna of 
equivalences form a sub-echemaof great generality 
and enter into all peocessesof learning. The accul- 
sition of such schomas are essential to learning. 
Such schemas do not arise merely by the pup knows 
ing if his answera are right or wrong; rather they 
seem to depend upon an active coordination by the 
subject of his existing schemas - on hia ability to 
order these actions simultaneously and to recog: 
nize their systematic equivalences. Good :eaching 
presents situations in which awe h coordination la 
possible and necessity, and In enough veriety for 
the pupil to diseoc tate whai Is common, although It 
Cannot ensure tlds. R will readily be realized that 
not all learning either In elementary or high school 
is of thisform, When a 9- or 1$-year-old is pre- 
gented with a problem for whith he has an adequate 
echema, he willassimilatethe problem to the 
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schema by an appropriate method of attack and ar- 
tive at a solution. This is learning of content. He 
hag not acquired a new method of coordination for 

he already had the method. Allthe problem did 

was to strengthen the tendency for this schema to 
be evoked when faced with problems of this type. 


The most elementary waysinwhich schemas can 
be coordinated have fust been indicated and all 
schemas probably lend themselves tothis forn, of 
coordination. But since these simple methods of 
coordination do not involve a simultaneous appre- 
hension of successive schemas by higher order 
schemas, the connections implied by the coordinas 
tions are linear. We thus have a linear series of 
acthons at the first level of abstraction Involving 
‘learning’ but little understanding. Most learning 
In the mentatiy retarded, and much in ordinary hu- 
mans, Is of this type. 


Let me emphasize that 1am well aware that I 
have not allowed myself to get bogged down over the 
question of whether or not the stages of cognitive 
growth that I have Indicated do actually exist in the 
child's Intellectual growth. Piaget has deen much 
criticized over his stages, some having argued that 
stages do not exist In other aspects of growth. The 
current practice among researchers of subjectively 
deciding whether responses can be fitted Into Pia- 
get’s schema of stages is obviously not sultable for 
assessing the validity of these stages. More objec- 
tive methods are required which would allow the 
data to determine their own patterns and groupings 
and to confirm or deny the existence of stages. 


FINDINGS FROM RESEARCH ON PIAGET’S IDEAS 


The second part of my paper is about the findings 
from the research that has been carried out to test 
Piaget's ideas. Ihave heavily condensed the liter- 
ature above stnce the material now at hard (s very 
great. Studies have been made in the realm of the 
general growth of logical thought, Into the child's 
ability to classify and serialize, and Into hie notions 
of apace, time, causality, and the like. Whatever 
the future holds regarding the presence of stages, 
it can be said at the present that reaearch shows 
that a high proportion of protocols obtained from pu- 
pils can be gut Into the stages proposed by Piaget, 
or Into Intermediate stages. Ristruae to say that 
the broad picture of the growth of thought, pre- 
sented by Piaget, has beenconfirmed, although 
there are many blots on the canvas, and at times 
one must be extremely critkal of Ais work. But all 
in all be has done more than anyone else to throw 
light on the growth of thought processes. His ex- 
perimenta will stand the teat of time, although bis 
theoreticel system is cerlain to undergn changes, 


The great number of studies relating io the 
growth of concepts shows that it is between 8 and 8 
yeara of age thal the pupil begina tc elaborate the 
basic concepts of trathe matics and aclence for he 
can now dissociate the part played by himsed! In or- 
dering his experience. Ew2 take, say, the concept 
of time, has been ampty confit med that the chiki 
begins to coordinate instants and Intervals around 
8 years of ace, although he may well have dbeea es- 
ing time words and telling the time for som years 
qeevbusly. Likewise experiments relatig to the 
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overall growt?. cf logical thought have shown the 
same general progression whether inthe area of 
science, history or religtous thinking. The availa- 
ble data again confirms that it is not until 13 to 14 
in ordinary pupils and ii to 12 inthevery able, that 
for mai thought is possivle and second order con- 
cepts are elaborated. I must stress, howevr, that 
the atages are net clear cut, axi I shall retura to 
this point. Indeed the stages are blurred, 80 that 
when & pupil is approaching the stage of concrete or 
formal thought, he is found to be ata more advanced 
stage of thinking {n one situation thanhe is in an- 
other although both Involve the same operational 
structure, It is also true that in some experiments 
certain stages appear to be absent; some responses 
are found that cannot be fitted Into Plaget’s stages; 
and occasionally a child is found who appears tocon- 
serve, say, weight before substance. On the other 
hand, there if no research {!at I know of, that has 
shown that Piaget was wrong concerning the se- 
quence of stages for any one aituationfor any one 
child. This was clearly seen in & recent study, just 
completed, where a group of boys waa tested on the 
same experiments each year between lland 15 
years of age. 


It would not be irappropriate if I now gave you a 
couple of examples of protocols obtained inarecent 
study In the growth of logical thought In relation to 
history. It will keep our discussion well and truly 
about children. [take the example from history as 
I cannot then be accused of being interested only In 
mathematics and sctence. Pupils read a story con- 
cerning William the Conqueror - the last man who 
successtully invaded England and that was In 1066, 
With the story stilt fa front of him, each child was 
asked individually, ‘Was William the Conqueror a 
cruel man?’ This was followed by‘ Why do you 
think 807” 


One pupil age 13 years & months gave areply 
that was Clearly at the level of concrete thought. 
He said, ‘Well, William wasn't Crue) at the begin- 
ning decause he allowed the English lo collect the 
dead bodies. ff he was really a cruel man he woukd- 
n't even have allowed that. Yet tater on, after the 
Danes had teft, he'd no need to take revenge. He 
could have reconquered the North - tried to make 
treaties and things.’’ Here the pupil could use the 
information provided, but he was not able to form 
a mature hypothesis from a consideration of all the 
implications in a situation. 


Another pupil age 14 pears and 8 months replied 
at lhe level of formal operational thought. "Rde- 
pends on what you callcrvel, Ethe definition of 
‘crvel’ is to kill and ravish and burnfor any purpose 
whatever, William was cruel On the other hand, 
WU one is preyered to accept polilicalneceassity, 
William's cruelty was juetified. Compared with 
many other feudatories, knights and 80 on, he was 
essentially a kind man. They ravaged generally for 
their own advantage and withouwl eare for the com: 
mon folk of the land. Duke William, @ the common 
people wert with him, seema to have been prepared 
to protect Ue common people from ravages. ¥, bow- 
erer, they went against him, he seemalo have 
treated it as a deliberate breaking of faith and acted 
accordingly. So, by the standards of Ms own dag - 
ior we really cannot judge him by our standards - 
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he was probably net a ‘cruel man.’ ’’ This pupil 
was clearly able to reason by implication of an ab- 
stract lead. 


One of the consistent findings in our studies at 
Leeds, and it has been supported by the work of 
Jackson (1965) = a student of Dr. Lunzer of Man- 
chester - is that only a proportion of school educa- 
ble retarded puptls reaches the level of concrete 
operational thought even at the age of 15, It has re- 
peatedly been shown to be true in respect of mathe- 
matics and sclence; while recently we have shown 
that the growth of English morphology in such chil- 
dren, even at 15, is less advanced than that of nor- 
mal children of 4 and 5 years of age ifwe accept 
Berko's (195£} data as representative of American 
children. Our findings, which will be published, 
were predicled from our knowledge of the thinking 
of this type of child in other areas, The learning 
problems of school educable retarded children, and 
of the least able left in elementary and high school, 
stem from the fact that their schemaa permit only 
a linear series of actions below, or just at, the lev- 
el of concrete operational thought. They learn, but 
they do not “understand,” Transfer certainly takes 
place in these pupils ag it did in Harlow’s apes, dut 
only when the schemas Involved are less complex 
than those required at the level of concrete opera- 
Uonal thought. 


One great issue that research hasclearly indi- 
cated is tnat problems that appear to have the same 
operational structure are not allsolvable atthe 
game lime. Much research snows that both concrese 
and formal operational thought is, at first, a task 
specific within limits, and that thinking Is not organ- 
ized to the extent that Piaget’s theory would indicate. 
Dodwell (1960, 1961) showed that there was only a 
moderate correlation between tests which, In Pia- 
get’s view, all Involved the same level of thinking 
end which all involved integral aspects of the number 
concepts. Later Dodwell (1962) pointed out that 
while the concepta of class and number develop with- 
in the same age range, there was no clear Indication 
that they both arose together or that one was elabo- 
rated before the other. Likewlse we at Leeds have 
found, as did Dodwell (1969), that a pupil could be 
at different stages of thought In three tests dealing 
with the concept of axes of reference. Indeed, Pia- 
get (1960) himself has now admitted that operations 
are ofly gradually applied to larger and larger nu- 
mertcel sets, while he has always made it¢leac that 
Kt takes a child, on the average, two years to gen- 
eratize concrete operations involved in appreciating 
conservation of quantity before they can be applied 
lo conservation of weight, althoughfromthe point a 
view of Cognitive structure the operations are the 
same. Even when the concept Involved remains pre- 
cisely the same, the quality of the child's thinking 
will vary according to the apparatus used (cf. Lovell 
and Slater, 1960). 


R would, of course, be unfair tothe Genevan 
workers Wf one failed to emphasire that they have 
made some provisicn for these erentualities. Inheld- 
er and Piaget (1988) poimed out that contrete opera: 
tions consist of the direct organization of imme fiate- 
ly given data and they cannot be generalized to a!l 
situations atonc®, For example, length ts con- 
ceived before weight This, in the view of Inbelder 
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and Piaget, is because It is more difficult to serial- 
ize, equalize, ete., objects whose properties are 
less easy to dissociate from one’s actions, e.g., 
weight, than to apply concrete operatlons to proper- 
tles that can be rendered more objective, e.g., 
length. Piaget (1956) also speaks of the notion of 
“horizontal differentials.’’ This suggests that the 
same or Similar concepts when derived frum differ- 
ent materials or siluations, developin staggered se- 
quence rather than simultaneously. But this notion 
does not (it well Into his general theory, 


At the level of formal thought we find much the 
same. Ina study recently completed, in which chil- 
dren were questioned individually, we have found 
that the schema of proportion is notavailable in 
problems involving money, speeds, areas, series, 
etc., at the same time. Mathematical concepts 
seem often to be available at first In specific situa- 
tions, even when they depend on second order oper- 
ational schemas. Lack of specific experience, in- 
formation, vocabulary, expectancy or individual dif- 
ferences in intellectual functioning which are un- 
known, most probably all play some part. 


A numbe? of studies have been undertaken, based 
on a neo-behavior ist approach, to see if intensive 
periods of specific training lasting afew weeks, can 
speed up the growth of understanding of particular 
issutc; ‘or examele, the Conservation of number or 
weit. Te: outcome of these studies bas teen 
largely «conclusive, Plaget’s view (Ripple and 
Rockcastle, 1064), which was expressed in 1964, 
Ig that the child may learn something of the situa- 
tion, but the training will have no effect on his gen: 
eral level of understanding for the 'pecific attack 
i3 too trivial. The modification of a chiki’s mental 
structures In Paiget’s view, necessitates afar 
wider, more lasting, and more radicalapproach 
which Invcelves many of Its child's activities. 


THE WORK OF SMEDSLUND 


tn concluding this section of my paper Iwill re- 
view a few details of a recently published work of 
Smedslund (1964), ft was a very Important study as 
it {a extrememly relevant to some of the points that 
t have raised in this section of my paper. The spe- 
cise parpose of the study was to investigate the in- 
terre lacions of the specific acquisition of ability for 
concrete reasoning veing different Items. He care- 
fully laid down a number of methodological rules 
which were apptied to the construction of items In 
order to maximize their diagnostic validity, The 
items inched class inclusion, reversal of spatial 
order, conservation of discontinucs quantilles, con- 
servation of length, transitlvity of length, etc.,~ 
nine items in all. Many of the items have sub- items. 
All the tests were given Individually to 160 children 
age 4 years 3 months to 11 years 4 months, evenly 
distributed over age and sex. 


the upshot of his findings was that ender the giv- 
en conditions of the experiment, one could predict 
with a fairly high degree of confidence from the eut- 
cessor failure on one sub- item to success or fail- 
ure on another sub-item; that is, Intra-{lem relia- 
bility was high. On the other hand, the picture was 
different between items, for the Inter - item 
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relationships were far lower. The difficully of the 
{tems varied f.om 122 passes to 77 passes. When 
children who had passed or failed all the items were 
excluded, only 18 percent of the remaining subjects 
confor med with the bypothesis that the items are ac- 
quired ir the order of their difficulty as measured 
by the total number of subjects passed. 


Smedslurd poirts out, in retrospect, what he con- 
siders to be a marked weakness in his study. He 
proposes that when investigating a concrete reason- 
ing task we need to make a cleardistinction between 
percept - a process depending upon the momentary 
stimulus input; goal object= that which the subject 
{8 told to attain; Inference pattern which is 
formed by the set of premises and the conclusion. 
For example, the stimulus situation as apprehended 
by the subject are the percepts; quantity and length 
are goal objects; and conservation and transitivity 
are inference patterns. Smedslund thinks that since 
all three factors influence the solution rate of items, 
the effect of a single factor can only be studied with 
the others held constant. The author is of the opin- 
jon that other things being equal, conservation pre- 
cedes transitivity, but he feels that only tn relation 
to one goal cdject, and one narrow perceptual con- 
text, will it Ge possible to determine whether or not 
conservation, transitivity, seriation, associativity, 
commentativity, addition/subtraction, mulliplica- 
thon, ete., are acquired In righd predictable se~ 
quences. Here, indeed, is a fie'd for research. 


IMPLICATIONS 


In this section of my paper, [ want to discuss my 
Inter pretation of the educational implicaticns of Pia- 
get’s work and to suggest onr or two lines of re- 
search. Tobe helpful [have listed a number of points. 


1, While experience is alwaysnecesearyfor men: 
tal growth, Piaget is clearthat mere submission to 
external experience is not sufficient to make a chiki 
restructure his own thinking. Rather the child has 
to be active. He has to act on material thinge and 
become aware of the significance of his actions. 


2. His observations led him to believe that it is 
schemas thal are in the process of organization that 
chiltren tend to repeat playfully and with seeming 
pleasure. Further, when such echemas hare be- 
come organized, the apparent pleasure disappears 
and the schemas cease to be repeated untess they 
are combined to form new schemas or serve asa 
means to some end. } earning then seems to start 
from the child, from the eche mas that he already 
has available. Actions on his part, that is, explor- 
ing, discovering, using new ways to solve old prob- 
lems, ali have an intrinsk interest for the young, 
and are seM-extending. Naturally the tevel of In- 
trinsk motivalion varies from child to child, due, 
perhaps, to the level of activity In certain areas of 
the cemral nervous Syslem. Bul when the schemas 
required for the aolution to some probdlem are not 
too far remored in compleaity from those available 
to the child, the inadequacy of existing schemas will 
force hlm to accommodate to the conditions of the 
problem, Hence the chikddresiructures his own 
echemas toward greater cognitive adaptation to his 
environment. Not only does the chiki solve the probd- 
lem, bol he extends his capacity for further tearn- 
ing. The imptication of Piaget's {findings ts that we 
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need to begin to stimulate the intellectual growth of 
the child in the early weeks of life. Thechild needa 
to encounter a variety of changes of sensory exper|- 
ence in respect of sight, sound, touch, and move- 
ment. He needs an opportunity to see and grasp a 
varlety of objects, and later, sultable toys that in- 
volve him in a greater range of ections; opportuni- 
tles for physical movement and experimentation; 
and novelty. We must always bear inmind that 
there must not be too great agapbetween the 
schemas available to the child and those demanded 
ty the situation. Yet in spite of the help given by 
Piaget in assessing a child’e level of thinking, what 
is involved in producing the correct amount of gap 
between the schemas available (o the child and those 
demanded by the situalion remains vague. This is 
where the Intuitive skill of the teacher is called for, 
tt ls his task to arrange, or find In the environment, 
problems which call forth the schemas of the child 
in new and novel ways. 


3. While language acts as a vehicle for thought 
and enables [t to be carried Immense ly further, 
language is f{tted into the thinking thai originates In 
the first two years of life. H thought and language 
are to keep In step wilh one another as the child con- 
Unvousty models his language on that of adults, the 
child must be active in building his thought peoc- 
esses. If this Is not the case, itis more likely that 
the child'a verbalizations will lead adults to think 
that he understands more than he actually does. 
There is a grave danger of this happening between 
about 2 and § years of age since the chiki has copied 
the adult model of language yet he remains at the 
pee-operational level of thought. One f:ndamantal 
lesson for parent and teacher from Piaget is that 
while language is important, mere verbalization and 
verbal knowledge are of little value in themselves. 


4. Piaget (1926) indicated that social influences 
play a role In helping a child to move from cognitive 
egocentrism to sysiematic thought. Mere experl- 
ence may have no effect on the available schemas, 
or an attempt may be made to distort the experience 
80 that it could be assimilated. But sccial interac- 
thon with the peer group forcesthe child to re- 
examine his own thinking, 9 that he can satisfy his 
need to share the thoughts of others and his need to 
communicate with them. Argument with the peer 
group forces the child to reason with himself. Like- 
wise, dialogve and discussion with parents and 
teachers, the answering of questions, etc. ,contrib- 
ute to the growth of concrete operational thought. 


5. Piaget’s views clearty support what is broad- 
ty cal’. a discovery approach to learaing with a 
Jodick ase of exposition atthe elementary echool 
level. ct in high school more use can be macte cf 
exposition since the chiid's ability to appreciat2 th? 
form of an argument Improves, and he is able to 
elaborate concepis not themeelves derivable from 
first hand experience. The Geneva school argues 
Unat the onset of the etage of fc« mal thought is ret- 
alive to the culture pattern. Beyond the age of 12 
years or 90, due iv aryatological factors, this lev- 
elect thinking may be a product of the progressive 
acceleration of individual development under the in- 
fleence of education and culture. The 13 year-old 
is not only dissatisfied with the gapa and wncertain- 
Ues resulting from concrete operational thought, 
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but he Is beginning to think beyond the present. 
This thinking ahead is likely to be determined by the 
experiences received at home, at school, and at 
work; his social attitudes; the climate of opinionand 
expectancy in the community, and the concepts that 
are frequently made use of in the society. In com- 
mitting himself to the future, the adolescent begins 
to build theories. 


Ali high school puplis thus need the opportunities 
to discuss with adulls and teachers, and among 
themselves, viewpoints and theories relating to var- 
led problems; the viewpoints and theories some- 
times being in direct conflict with one another. They 
also need the chance to see, at first hand, the kinds 
of employment that will be available tothe m, and 
be in & position to think of, and discuss, their fu- 
ture roles ea workers and citize.s. They thereby 
get greater opportunities to comma: themselves to 
possibilities. The greater the need to question and 
find out, to slruggle foz solutions to problems, and 
to commit oneself to possibllities, thegreater 
seems the likelihood of formal thought developing. 
It may be that the culture pattern rather (han the 
school plays the greater role in the growthof formal 
thought although we do not know Uf this Is 80 in fact, 
Peluffo’a (1964) study, which compared children 
born in Sardinia tut who had been inGenoa for vary- 
ing lengths of time, with children born and bred tn 
Genoa, gives some indication ofthe likely effects of 
the culture patterr on the onset of for mat thought. 


6, In the upper-elementary classes and in high 
school, extrinskt motivation begins to influence the 
puplt. For example, he may become aware of what 
his parents or society expect of him; or he may fear 
fallure or punishrrert Lf he does not work hard. One 
must not belittle tnis kind of motivation for tt often 
stinrlates the child to learn and to work as hard as 
he can at the level of thinking at which he is, But 
there is no evidence that it can, in itself, change the 
quality of the pupil’s thought. Extrinsic motivation 
may well hold a pupil to a task, and in virtue of the 
prolonged child-task inter-*ction enable him to re- 
structure his own schemas. Thus externat Influ- 
ences which are at work over a number of years, 
as, for example, parental encouragemesi,can play 
an Important but lodirect part in intel’ectual growth. 


CONCLUSION 


In conclusion, I would like to suggest areas in 
whith we need research: 


1. What are the long-term effects of very early 
stimulation cé the culturally depeived and of certain 
types of school educable retarded chikiren? Hf such 
ls Commenced during Pieget’s sensori- motor stage 
of developmen, how do the long-lerm owleomes 
compare with those outcomes when the enriched en- 
vironment is delayed until 3 and Syearsof age? The 
recently reported long-term study of Skeels (1965) 
in Ameria suggests that very early atimulation 
may be of great Importance. And what is the most 
suitable stimulathor to provide at 6, 9, 15 months? 


2. What are the long-term effects of an education 
tased, as it were, on Piagetian ideas, particularly 
when they employ m.terials and situations of intrin- 
atc interest to the child, from K throughgrade 4? 


Of course there will be some exposition, as there 
will be an increased proportion of time spent on ex- 
posktion in the upper classes of the elementary 
school and In high school. What are the long-term 
effects of such methods over, say, 15 to 18 years? 
Is there any difference between such children and 
those brought up on other approaches at the second, 
fourth, eighth, and twelfth grades? 


3. What is the effect of the emotional life on cog- 
nitive development? This is an important, allhough 
complex, question that cannot be brushed asida, In 
the 3 to § year period especially, fantasy - which I 
define as emotion clothed with images - is playing 
a rote in the growth of thought. Weignore this at 
our perli. If in real life a child can dramatize his 
fantasy, he may free himself from the dominance 
of fantasy, and thought processes may develop 
smocthly. When the 2- to 5-year-old is presented 
with a story or situation which he only partly under- 
stands, he brings to it his experiences and his fan- 
tasies to fill in gaps and structure, say, the story. 
Each young child will have something of his own In 
the interpretation of the stoi, for information can- 
not yet be classified systematically and objectively. 
In the fairy tale particularly - which again is only 
half understood ~ the child's feelings of fear, anger, 
love, ete., which already exist, are perceived 
by him In the story. The storyactsasamirror and 
he is helped in recognizing tne parts in himself In 
the ‘Good Prince’’ or ''Bad Dragon. '’ The 'mirror- 
like peoperties’’ of fairy stories, and the fact that 
he can structure it with his own experience and fan- 
tasy, perhaps explains its abiding value. Similarly 
the child deals with his fantasy in painting or model- 
Ing. At 6to 7 years of age fantasy {ts still at work, 
but fhe child is in better control. He may now ac- 
cept a story tha’ he could not tolerate at 4. Iamno 
Clinician in the accepted sense of the (erm, but I 
have enough experience with young clildren to know 
that Uhe fantasy life Is playing a role inthe growth 
of thought processes although we have little evidence 
in a sclentific sense on this point. What is the ef- 
fect of kindergarten and school activities and sh ich 
ate likely to help the child to control his fantasy? 
What is the effect of using rraterlals likety to have 
personal signiikance for him? The mathematician- 
logician may be forgiven for ignoring this when he 
is trying to teach kindergarten children something 
about sets. The psychologist and educator should 
realize that here is an Important field about which 
we know little. 


4. Whal is the effect of the culture pattern and 
subculture patterns on the growth of human thought 
Frocesses? We know something of the relation be- 
tween socioeconomit groupings and attainment but 
far less about such groupings and thought. Evidence 
from Hong Kong via Goodnow (1962), and from the 
Tiv trite of Nigeria via Price-Williams (196), 1962), 
suggests that culture pattern may not have as seri- 
ous effect on the growth of concrete operational 
thought a8 on formal thought, especially HW the ma- 
terials used are well tnown to the testees. Nerer- 
theless there is some delay al the level of concrete 
reasoning due to culture pattern as the work of Pe- 
haffo (1964) in Raly, and Aly (1966) in America. 
What are the characteristics of the eub-culteres 
that have the greatest downpulling effect? 
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5. We need to know why a schema, say. that of 
peoportion cannot be applied toa wide variety of 
situations atthe same time How important is fa- 
miliarity with the problem, lack of specific exper|- 
ence in that area, and expectations basedon previ- 
ous experience? 


6, We ned a very great deal of Information re- 
garding the growth of more advanced concepts in 
mathemalles and science, e.g. ,‘‘funclion’’ and ‘‘en- 
tropy. 


These questions that [ have raised are broad 
ones, but ones of great Importance. They are of 
significance to manking, not to just the Americans 
or the British. 
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mam Promoting Creative Thinking 


in the Classroom’ 


THE LAST decade has seen a shirp 
increase in the volume of researchoncreallvity rnd 
Creative thinking with @ major focuson isolating the 
basic processes of creative thought (Mednick, 1962; 
Mendelsohn and Griswold, 1964) and on identifying 
the unique characteristics of creative persons (Mac- 
Kinnon, 1965; Barron, 1964; Crutchfield, 1963), De- 
spite such un;recedented interest in Creativity. un- 
thi quite recently there has been relatively little re- 
search on the general problem cf nurturing and pro- 
moting creative thinking, especially in the claas- 
room setting. However, due partly to increased 
podlic awareness of the need to husband our inte !- 
lectual resources. this important topte Ia beginning 
to receive the attention and research support it de- 
serves, 


The purpose of this paper is to describe part of 
the research program at Berkeley for developing 
Curriculum peograms aimed at promoting the gen- 
eral level of creative thinking among elementary- 
school children and to conser some of the pedagog- 
teal Implications of such research, especially re- 
garding the value, feasidility. and fustifk ation of 
teaching for creative functioning. For a survey of 
other current research in this area representing 
differing theoretical and methodological approaches, 
see Myers and Torrance (1960, Osdornm (1953), 
Parnes (1965), Suchman (1961), arc' Upton and Samp- 
Bon (1961). 


By way of introduction, it should be noted that 
most of the current attempts to develop such teach- 
tng materials, including that of the Berkeley group, 
share two fundamental assumptions: (i}that all 
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chikiren, regardiers of age or initial Intellectual 
level, falb far short of realizing their potential for 
Creative thought, and (2) that these individuals can 

be taught to make fuller and more appropriate use 
of thelr capacities by means of systematic and 
direct training of certain cognitive skills. 


As for a definition of a creative child din areal 
sense the ultimate criterion by which the svecess 
of a teaching program must be judged), it ts gener- 
ally agreed that he ts intellectually curlous and ex- 
ploratory, taking an active part in manipulating and 
reconstructing his environment. To paraphrase a 
haimber of current definitions: 


The creative child prefers to explore the un- 
koown, rather than to conserve the already 
known: he prefers explaining facts in new 
ways, rather than Continuing to rely on tra- 
ditional well-established explanations; he in- 
dulges in adventuresome thinking and raises 
Questions, rather than being content with 
things az they are. 


With these preliminary comments setting the 
stage, we turn next to more pointed observalions 
about the nature of creative thinking and how best 
to foster it - observations which to a large degree 
have determined th: specific form and charactet of 
the research of the Nerketez group Asa first step, 
we will Kentify and discuss several widely- held mis- 
conceptions about creative functioning and its fecil- 
ftation. 
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MISCONCEPTIONS CONCERNING THE N/. TURE 
OF CREATIVE THINKING 


Perhaps the ost commonly held belief concern- 
ing creative furctiocing is thatthe child will become 
creative of his own accord — by drawing on some 
heretofore latent potential - ifonly he canbe placed 
In a stimuiating yet permissive and nurturing en- 
vironment. The erroneousness of this view is due 
not S0 much to a misreading of the nature of man as 
it Is to an oversimplification of the means by which 
his latent capacities are to be realized. More spe- 
clficelly, an environment which is at once per mis- 
elve and silmalating undoubledly plays an important 
roic in establishing the conditions necessary for 
Creative catput. but this ts only part of the story. 
In order to take full advantage of un unresiristive at- 
rosphere, the child must first come to understand 
wha consiltutes crtative ideas in th> given situation 
ard how he can achieve such ideas for himself, fn 
short, he must tearn how to thinkcrertiveiy. in 
this connection, a growing body of observational and 
empirical evidence (Hammer, 1961; Holt, 1964; 
Peel, 1049; Torrance. 1965) indicaiesthat most 
schoc! children are inadequately pr ‘pared for crea- 
tive thinking. Corroborative data gathered by the 
Berkeley group at the fiftu-grade and sixth: trade 
leve's reveal a conspicuous inability among stedents 
to think of any ideas, much lessclever or novel 
ones. Moreover, there is little understanding of the 
nature of originality and virtually no sense of plan- 
fulness which is neceasary for prolonged effective 
work on a creative task. Not surprisingly then, one 
finds that the responses of most children tochalleng- 
ing tasks, even in a permissive environment, are 
by and large pedestrian and generally lacking in 
creative merit. 


In order to think creatively the child must have 
at hie disposal a repertoire of creative thinking 
skills. Toname afew: the ability to recognize 
Gaps in existing information; a facility at formulat- 
ing relevant Questions, and a sensitivity tothe de- 
mands of the task 60 one can adequaiely Judge the 
suitability of proposed ideas. The epitomy of crea- 
live thought is a sense of ''disciplined abandonment. ’’ 
An array of cognitive skiils such as those Just men- 
Uloned constitutes the ‘‘diseipline’’ component which 
must de present in concert with an accepting nurtur- 
ing envitonment before the child can take full advan- 
tage of such freedom and “‘abandon’’ himself to the 
task at hand, Thus, seen in this perspective, the 
}od cf fostering creative thinking is a more compli- 
cated undertaking than suspected by many, It is 
mote than merely providing a permissive atmos- 
phere for the release of creative potential; it is 
more like leaching the child how to make use of his 
freedom to create. 


ff one must teach children to think creatively, 
then what kinds of pedagogical strategies would seem 
most appropriate? There are, no doubt.anumber of 
teasonable answers to this question. For example, 
one approach + the traditional one ~ fa to teach In 
guch a manner that the child will come lo act crea- 
Uvely in 4 namber of different subject-matter dias 
Ciplines. Another contrasting, yet complementary 
possibility is to teach for a namber of cognitive 
skills fundamental to all creative thinking and then 
show the student how such generalized skilla can be 
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applied In specific subject matter areas. This lat- 
ter etrategy carries with it the implication of devel- 
oping curriculum materials whose subject-matter 
is the creative thought process itself. As we Shall 
see presently. it is this approach which is being ex- 
plored by the Berkeley group. 


Although there is considerable latitude with re- 
spect to the variety of reasonable approaches for 
promoting Creative thinking in the classroom, there 
are liinits, Some limits can be established based 
On our growing knowledge of the dynamics of the cre- 
ative process, For example, it has been well es- 
tablished that creative thinking Is largely dependent 
on Cognitive operations and dispositions of a non- 
logical character. Yet despite this, the notion as 
well asthe practice pers'sts of teaching for logic 
and for critical thinking as means for promoting 
creative functioning. As we shalt see shortly, cre- 
ative thinking, whether ‘t be in science or fn the hu- 
manities, involves a good deal more than rational 
and critical analysis, and to teach only fer these 
functions to the exclusion of more imaginal specu- 
lative processes is to fall short of fostering cr ea- 
live thought. 


It has been further argued that teaching for scli- 
entific methods of thinking will establish a respect 
for the lawfulness and the simplicity of nature itself. 
Although the child may indeed infer from such ener- 
cises that nature is orderly and lawful, such a’. wus 
derstaiding may curiously enough act to fetter cre: 
ative thought. More specifically, ascurrently taugin, 
elementary school science, the humanities, and the 
social sclences a8 well, do not always reflect the 
way scientific investigation andcreatlve scholarship 
actually happen. Creative contributlons to any field 
of knowledge are made by wrestling with ambiguous 
conflicting facts and data win the overall aim of 
bringing conceptual order out of chaos. However, 
as represented in many current textbooks, the 
drama of the pursuit of such order and under stand- 
in, is replaced dy an c cersimplified, tailored, and 
predigested view of a discipline, emphasizing what 
(is already known and stressing the all-encompass- 
ing explanatory power of presently accepted theories 
or laws. Such a simple, clear-cut presentation 
which smoot's over comolexity and controversy is 
Gesigned primarily to make for more effictent learn: 
ing and retention. rather than to focus on the prob- 
lem of how the child himself can learnto manipulate 
a given set of facts, lodraw his own conclusions, 
or Indeed to discover newfacts, which is after all, 
one of the primary functions of the creative Innova: 
tor. There is tittle question that such textbook pre- 
sentatlons will make for the most rapid, untroubled 
assimliation and mastery of the mater ia!, but it 
should not be assumed thal (he approach which 
makes for the most efficlent learning will also be 
most effective in fostering creciive and productive 
Uninking. 


Moreover, in the way most abject matter haa 
been traditionally taught, the studeatis rarely al- 
lowed ta practice on problems which require Innova- 
tive modes of thought for their acluttion. Conse- 
quently, he has no direct opportunity to learn whal 
constitutes creative ways to manipulate data, nor 
to develop an Inteitive sense for designing research, 
dor lo ask Questions which favor sérendipity ard 
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maximize the chance for new insights. In short, 
the child does not acquire the cognitive ekitls which 
would be most helpful in preparing him for future 
productivity. 


A specific case in point illustrating the lack of 
emphssis on thickirg creatively about facts and {n- 
formation is the set of so-called ‘discussion ques- 
tions’? found at the end of many textbook chapters. 
As commonly used, these questions are not partic- 
ularly helpful In promoting creative patterns of 
thought. Often the student is merely asked to think 
about these questions with little or no subsequent 
follow-up discussion of the adequacy ofhis answers. 
With minimal dialogue betweeri the student and the 
teaching authority, the child rarely gets any syste- 
matic feedback as to "nat counts as merely an ade- 
quate answer as oppcsed to an Ingenious, novel one. 
Even In those cases where the teacher finds (ime to 
comnient on the quality of the pupil's essays, the 
feedback {s Inevitably delayed, thus reducing the e/- 
fecliveness of the exercise. Because the child typ- 
ically operates (rom questton to question in what fs 
essentially a ‘‘cognitive vacuury’’ with Iittle oppor- 
tunity to protit from his past efforts, he is unable 
to develop any internal efandards of excellence 

ainst which he can evaluate subsequent ideas. In 
effect this means he {s unable to modify his efforts 
in the direction of more crealive and imaginative 
output. 


Another feature of such discussion Questions = 
their placement at the end of the chapter = strength- 
ens the impresston that these exercises are simply 
an appendage, added to the tcxt as an afterthough: 
rather than forming a central part of the Learning 
experience itself. Moreover, their placeinent oc - 
curs at the paychologically Inappropriate moment 
for sttmulating productive tdeas, By the end of the 
chapter mach of the intellectual tension and drama 
butid up as part of the content presentation will have 
dissipated, making it difficall to engage further the 
chiid’s interest. in contrast, the placement of dis- 
cussion questions should be coordinated with the pre- 
sentation of the content itself, capitalleing on the 
student's Immediate curiosity and momentarily 
aroused interest. 


RECOMMENDATIONS FOR A CURRICULUM OF 
CREATIVE THINKING 


Recognizing some of these pedagogical deficien- 
cles, what can be recommended with regard toa 
¢currkutam for creative thought? The first recom: 
mendation is that seach a curritulam featare re- 
peated opportunities for the child to practice wrest- 
ling with complex challenging tasks of the kind that 
might, aa more complex form, engage the efforts 
of creative adults. O€ course, such problems (which 
we shall call ‘‘creative-tasks-in-mintatare’') mast 
be scaled down and simplified in many respects - In 
parilcular, reducing their dependence on technical 
or specific knowledge. Nevertheless, even with var- 
tous modifications Gf this type such tasks coeld still 
retatn the baste elements of any intellectually crea: 
Uve undertaking. A second recommendation is that 
certain broad guides and strategies for creative 
thinking be introdoced as the child works on these 
tatks. Such guides would act as points of reference 
around which the child could organize his work and 
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would impart an atmosphere of planlulness to the 
process of problem sotution. 


Next, what can be said more specifically about 
the nature of these ‘‘creative-tasks-in miniature’’- 
their particular content and the composition of the 
accompanying rules and strategies for productive 
thought? It ls sobering to realize that the creative 
Innovators of the year 2000 (only 32 years hence) 
are to be found in the elementary schools of today. 
As these individuals stand on the threshold of the 
twenty-first cenlury, they will be confronted by scl- 
entific revelations and social issues [fterally un- 
dreamt of today as well as alarge share of cld prob- 
lems left unsolved by previous generations, To 
meet these challenges the innovator of tomorrow 
must create new social systems, new sclentific tech- 
niques, tools, and theoretical structures. To 
accomplish this, he cannot rely on presently fagh- 
fonable views as to what constitutea frultful scholar- 
ship or good sclentlfic method, nor can we afford to 
Instill In him a blind devcdion to currently fertile 
theorles, since much of this theoretical apparatus 
is already approaching obsolescence. Here then is 
a compelling argument for the necessity of tcaching 
broad strategies for creative thought and of encour- 
aging cognitive flexibility and intellectual curlosity, 
rather than merely teaching for what we presently 
take to be true or useful. 


What kinds of tasks could children practice on 
now to prepare them for their roles as the Innova- 
tors of the future? Two kinds are suggested: the 
hypothetical problem and the enduring problem. The 

‘ormer type minimizes reliance on present facts 
and theories in ottaining a solution, while the latter 
type focuses on the deathless lesues of human af- 


fairs which are certain to be the subject of creative 
reinterpretation and re-evaluation in any future age. 


Typically In the case of the hypothetical problem 
certain artificial conditions are postulated which do 
not correspond to prestnt realities, and the {ndivid- 
ual is called on b operate within these internally 
consistent but artifict-l systems. One prodlem of 
this type, which itself has become popular as ameas- 
ure of creativity, ts the consequence test: given 
certain conditions, such as a world in which time 
tons backwards, whal are all the consequences? 
Such problems demand cognitive flexibility, imagt- 
nation, and the ability to adopt as temporarily real 
a set of foreign and urfamiliar assumptions. 


At Berkeley we are vow drawing up plans for an 
experimental tesching apparatas which simulates a 
visit to a strange planet. The stadent is pat in 
charge of the firat exploratory exmdition. His joo, 
a highly creative and demanding one, fs to come to 
understand and fo explain the welter of strange 
events which he wii encounter In this alien, anfa- 
millar world where the usual physical, btological, 
aod social laws are suspended or greatly modified. 
Here the child is literally confronted with a hy pos 
thetical world which, although it is ordered and In- 
lernally consistent, operates inways that ran 
courter to his previous’ experience. He must sas* 
pend his present expeclanctes about the world as he 
knows it long enough to create new explanations for 
strange and perplexing phenomena. Thas,by per- 
mitting the child to deal witn hypothetical lacks which 
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call for tha creatlon of new systems of Ideas, Inde- 
pendent o. present facts and assumptions, he can 
hedge ag‘:inst the time when these facts wlll outllve 
their usefulness and will no longer serve as a basis 
for productlve thought. 


Granting the largely unknown course of future 
events, there are nevertheless certain enduring 
problems of man and soclety which are constantly 
reasserting themselves and no doubt will engage the 
attention of future creative thiukers. The young stu- 
dent of today can best be prepared tocope with such 
Issues in adulthood by being presented now with re- 
peated opportunlties to deal with enduring themes 
and quandries: to search for new {mpllcations and 
to re-phrase them in contemporary terms. Many 
of che most sultable teaching examples are fowsx in 
literature, such as the Greek mythofSlsyphus, deal- 
ing with man’s reluctance to accept his fate; the 
tragedy of Frankenstein, reflectIng the consequences 
of man’s age-old drean of creating 4 more perfect 
being is hls own image; or the mythical Icarus, per- 
sonlfylng man’s unflagging zeal to explore nature 
regardiess of the consequences. Of course, itis 
understood that such issues cast in the form of teach- 
ing examples would have to be greatly simpllfied 
and made appropriate to a child’s level of under- 
standing. Notlce, however, that such modificatlons 
are made easler by the fact that the tradltlonal ve- 
hicles for the dramatizatlon of these issues are 
themselves reasonably constant - the novel, the 
play, and the poem — providing already familiar 
media through which children can express thelr 
ideas. In this connectlon, we shall presently de- 
scribe a “‘creative-task-in-niiniature’’ In which the 
student creates a play dealing with yet another tlme- 
less and recurring theme — the plight of the wrong- 
fully accused. 


Finally, what are the sources on which one can 
draw in formulating a set of broad cognitive skills 
and strategies which could be taught now to prepare 
children for future productivity? Informatlon con- 
cerning such generalized cognitlve stratugles canbe 
gleaned not only from laboratory research deal- 
Ing with complex problem solving and thinking but 
from anecdotal and life-history accounts of highly 
creative Individuals as well. Inthe first instance 
there !s a steadlly accumulating body of knowledge 
from the psychological laboratory concerning the 
kinds of factors, both facilitatlve and inhibitory, 
which influence the course and quallty of productive 
thought. One wilely documented example Is the del- 
eterlous effect of rigid mental set on effective prob- 
lem solving (Luchins, 1942), Here, because the in- 
dividual inltially formulates or percelves a task In 
a narrow and inherertly biasing way, he is effectively 
sealed off from attaining a solution. Anumber of ap- 
propriate thinking strategies Incorpora..ng these and 
other research iindings can be formulated, For ex- 
ample, with reference to the present example of 
mental set, the student can be taught to view a prob- 
lem broadly, to re- phrase questlons in new ways, 
and to resist jumping to premature conclusions. 


The other source of cognitlve strategies comes 
from anecdotal descriptions of creative individuals 
at work (Ghiselin, 1952; Koestler, 1964), A number 
of insights into the fundamental nature of creative 
thought have grown out of suchobservations as well 


as the discovery of Lmportant phenomena assoclated 
wlth creativity, such as incubationand Intuition. As 
an eaample, the famous and widely clted se lf-re- 
ports of Poincare, the French mathematician, have 
served to focus attentionon the conceptually fertLle 
notlon of creatlvity as basically a process of recom- 
bining ideas In new and novel patterns, And of most 
relevance to our !mmedlate concern, such observa- 
tlons have led to the elucidatlon of a number of spe- 
cifle problem-solving strategles, among them the 
technique of Identifylng the essentlal elements of a 
problem situation and dellberately juxtaposing them 
in varlous ways (Campbell, 1960). 


By combining the experlmental laboratory ap- 
proach and its virtues of empirical valldatlon with 
the rich and broadly inclusive self-reports of the 
highly creatlve thinker, une can formulatea set of 
rules and strategies which are pervasive enough to 
apply to a variety of creative tasks, yet simple 
enough to be readily understood by elementary- 
school children. 


In summary of the first section of this paper It 
has been argued that before the student can take full. 
advantage of a permissive stimulating atmosphere 
he must be taught how to think creatlvely. In devel- 
eping a teaching prcgram for creatlve thought the 
single most Lmportant pedagogical Issue ls the long- 
term social and personalusefulness of what is 
taught. It has been suggested that one reasonable 
teaching strategy, in light of this conslderation, Is 
to strengthen those cognitive skills basic to all cre- 
atlve thought in the context of complex yet meaning- 
ful problems which reflect the principal steps in the 
creative act. These observations, taken as a whole, 
have formed the broad guldelines for the research 
carried out by the Berkeley groupover the past 
several years. 


THE PRESENT RESEARCH 


As a first step it was decided to develop a set of 
prototype instructional materlals deallng with only 
one aspect of productive thought- creative problem- 
solving. If the particular teaching approach showed 
promise, then other programs would be designed 
focusing on yet other domains of creative thought 
such as creative innovation and creative expression. 


After several years of intensive effort involving 
p.nerous pilot tryouts, successive revisions, and 
seveval full-scale experimental studies, the Gen- 
eral Problem Solving Program was developed (Cov- 
ington, Crutchfield, and Davies, 1966). The Gen- 
eral Problem Solving Program (GPSP) consists of 
asertes of sixteen ‘‘creative-tasks-in-minia- 
ture’? designed for the fifth-grade and sixth-grade 
levels. These problem episodes actasa vehicle by 
which the student practices a number of broad rules 
and strategles concerned with varicus facets of ef- 
fective problem solving, such as stat'ng the pr ob- 
lem in an open and unbiased fashion, refor mulating 
the problem in terms of familiar metaphors and 
analogies, or developing a systematic plan for gen- 
erating ideas. 


Each lesson presents a mysterious occurrence 
or unexplicable happening which the student tries 
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to explain, such as the puzzling behavicr of a group 
of aquanauts during a deep-sea dive, This general 
theme — the inysterlous occurrence - wa3 chosen 
because ki encompasses ina natural and uncuntrived 
manner many of the fundamental aspects of the prcb- 
lem-solving process. In addition, sucha theme is 
neutral with respect to orthodox curriculum mate- 
rials. This makes for a broader transfer of what 
is taught than might otherwise be the case if the 
principles and concepts had been associated prima- 
rily with a specific content area. Finally, children 
exhibit a keen Interest in working on problem situa- 
tlons featuring a mystery-detection theme. 


Each lesson is presented in booklet form and is 
cast in a self-instructional linear format. (For a 
theoretical discussion of the potential uses of pro- 
grammed instruction for fostering higher - order 
thought processes, see Crutchfield and Covington, 
1965.) Briefly, the child works through the lesson 
in a step-by-step sequence by himself and at his 
own pace, As the problem unfolds page - by- page, 
with the advent of new facts and clues, the student 
is called on to reformulx : the problem in his own 
words, to list questions he considers crucial to the 
solution or to devise a plan of action which he In- 
tends to follow. The student receives immediate 
guidance in his efforts on Successive pages of the 
booklet. This guidance typically takes the form of 
presenting a range of ideas, questions or courses 
of action which the student might have thought of in 
the given situation. Here the emphasisis on en- 
couraging appropr late diversity in the student’s 
thoughts by showing him within wide limits what 
constitutes valuable ideas, crucial questions and 
frultful ways to formulate problems, 


The GPSP !s also designed to promote beneficial 
attitudes toward productive thinking. One of the 
basic Strategies !s to Increase the child's exper i- 
ence in coping successfully with thought problems. 
Fach problem episode is sequenced so that as the 
student works through the booklet he is exposed pro- 
gressively to more clues and hints. Thus, each 
child, independent of his initial capacitles or per- 
coral reservations about thinking, willat some point 
come to discover the solution for himself. In addl- 
tion there is a systematic attemptto foster, by 
means of appropriate teaching examples, a number 
of attitudes which favor effective problem solving, 
such a8 open- mindedness, persistence, and suspen- 
sion of premature judgment. 


A story-line is maintained throughout the GPSP 
to supply a sense of continuity, and perhaps most 
{mportantly, to provide the reader witha set of iden- 
tliication models. The story concernstwo school 
children, Jim and Lila (brother and sister), whose 
extra-curricular pastime is the exploration of mys- 
terious situations which arise in and around their 
hometown, Jim and Lila are assisted- and when 
the occasion demands, assiduously directed ste p- 
by-step — through these adventures by their uncle. 
The uncle In addition to being a high-school science 
teacher also ‘‘mooniights’’ as a detective, 


The identification- model technique Is intended to 
introduce the reader gredually to the difficult and 
often frustrating process of becoming a more effec- 
tive thinker. For example, the roles of Jim and 


Lila reflect the vicissitudes associated withallcom- 
plex problem solving - the long disccuraging per |- 
ods of intense effort with little apparent progress, 
the inevitable setbacks, and finally, the intellectual 
elation of discovering a sclution. Through Jim and 
Lila the reader can experience all this vicariously 
without being plunged immediately into the situation. 
After the first few lessons, however, the reader is 
gradually drawn into the various problem-solving ac- 
tivities by being requested to think ofand to record 
h's own Ideas in concert with the efforts of Jim an¢ 
Lila - first the student generating his own ideas or 
questions, then Jim and Lila respo.ding with theirs. 
The feedback examples provided for the reader are 
presented as Jim’s and Lila’s ideas. 


Against this backdrop of transitory day-to-day 
successes and failures, a long-range change takes 
place in Jim and Ltla. They are depicted as over- 
comlng initial handicaps of reticence, apathy, and 
negativism toward thinking until ultimately, but not 
without an occasional setback, they become reason- 
ably comfortable with their own thought processes, 
much more enthusiastic about tackling problem sit- 
uations, and more confident in their ownabllities to 
cope with them. It is hoped that this subtle but per- 
ceptible change in Jim and Lila willfoster in the 
reader a sense of his own progressive improve ment. 
At the same tline It is :ntended that as many readers 
as possible will finally come to surpass Jim and 
Lila ': problem-solving proficlency and willoutgrow 
any “rlier dependence on them as a sourceof Ideas 
and inspiration. 


The Inclusion of the uncle provides Jim and Lila, 
and presumably the reader as well, with a benevu- 
lent authority figure and<« = idant who not only nur- 
tures and encourages the nascent attempts of these 
tyro-thinkers buc who also shows them how to think 
for themSeives by moans of appropriate rules and 
strategies. Additionally, the uncle stands as a val- 
ued model personifying an enthusiasm for intellec- 
tual exploration. 


Each lesson |s presented in an illustrated format. 
Such a dominantly visual presentation not only in- 
creases the student’s interes! in the materials, but 
makes it easier for him to follow the necessarlly 
complicated dialogue and thought sequences of the 
story characters. The lessons contain an average 
of 40 pages and are designed to be presented at the 
rate of one lesson per day. The average time taken 
to complete a lesson is approximately 35 minutes. 


Several separate studies (summarized in Coving- 
ton and Crutchfletd, 1965) have been carried out us- 
ing various preliminary editions of the GPSP which 
to date have involved a total of some 481 fifth-grade 
and sixth-grade schooi cii!ldren from the San Fran- 
cisco Bay Area, of whom 267 were given the train- 
ing materials ..d the remaining 214 were used as 
controls. The basic design of these studies is es- 
sentially the same. All students are first adminis- 
tered an extensive pretest battery (six hours in 
length in the latest study) which consists of anumber 
of tests of creative thinking (Torrance, 1965), tests 
of problem-solving ability (Covington, 1966c), in- 
ve, corfes designed to measure the child’s attitudes 
toward problem solving and thinking (Alton, et. al., 
1967), and various tests of sctwol achievement and 


PROMOTING CREATIVE THINKING IN THE CLASSROOM 27 


scholastle ability, These data are used as a basls 
for the Initial matching of the classrooms. Individ- 
uak classroo.ns are matched in pairs; one class- 
rcom from the palr {s then assigned at random to 
the instructed condltion and the other tu a control 
condition. In eachof the various studies to date, 
the instructed groups have always been administered 
the GPSP, In contrast. a numbers of different con- 
tro! conditions have been used to test various hy- 
potheses about the nature of the tralning effect. The 
typlcal case, however, and the one onwhich the 
present analysis ls based, calls for the administra- 
tion of a simllar but shorter set of seUl- instruction- 
al materials whose content is unrelated to problem 
solving. The purpose of the control program is to 
insure a sense of involvement and participation on 
the part of the contro] children and to make certain 
that they are well] acquainted with the self-instruc- 
tional format, Following the training period all 
classes are administered a posttest battery which 
includes a repeat of the attitude Inventories and the 
tests of problem-solving abllity along with parallel 
forms of the tests of creative thinking. 


Several examples will suffice to illustrate the 
general types of tests Included In the pretest and 
posttest batteries — their content, style and degrce 
of s{mllarity to the tralning materlal. One type re- 
flects the more traditlonal tests of problem solving. 
In these instances, because of a Jarge nurnber of re- 
strictions placed on the task, there is only a limited 
set of answers or principal solutions which will sat- 
isfy the problem In its entlrety. Here an emphasis 
is placed both on convergent and divergent thinking. 
The student is called on to diverge in his search for 
appropriate ideas - opening up a host of possiblli- 
ties - but at the same time to converge, focusingon 
the few most Sultable ideas. A representative sam- 
ple is the X-ray problem (a modificatlon of the clas- 
sic problem used by Kar! Duncker). The child 
is required to invent a method to kill a tumor deep 
inside a body by using an X-ray but without harming 
the surrounding healthy tissue. The primary con- 
straint {s that if the X-ray 1s too strong it will kill 
both the healthy tlssue and the tumor. If, on the 
other hand, the X-ray is made too weak, {t will not 
harm the good tissue, but nelther will it kill the tu- 
mor. Incidentally, thls problem in addition to pos- 
sessing a highdegree of curriculum relevance |s 
quite unlike anything encountered in the training 
lessons in terms of content or theme. 


The other main type of problem included in the 
criterton batteries ls the Minnesota Tests of Crea- 
tive Thinking (Torrance, 1965). Such problems are 
quite open-ended with few constraints. This allows 
for a number of solution-ideas, no one of which can 
be judged as the most suitable. One example featur- 
ing a product-improvement theme requires thechlld 
to think of all the ingenious clever ways to make a 
toy dog more fun to play with. 


Ag to the results: in general, the outcomesof the 
various studies employing the GPSP have been high- 
ly consistent. The perforrnance of the instructed 
children is markedly superior to that of the control 
children both on the tests of problem-solving ability 
and on the tests of creatlve thinking. (For adetailed 
report of findings as weil as a dlscuscionof scoring 
procedures, seF Giton, et. el., 1957.) 


In order to gain a clearer picture of the over-all 
magnitude of this tralning effect, consider several 
performance indices such as total ldeas generated, 
total quality of ideas, mean quallly per idea and the 
Incldence of principal solutions. Composite scores 
for each of these Indices are computedfor every 
student by Summing over his performance on «a num- 
ber of problem-solving tests In the posttest battery. 
In the same manner a similar setof composite 
scores is obtained for the tests of creative think- 
Ing. On comparing the mean values for the instruc- 
ted and contro] groups on any of these composite in- 
dices it 1s found that the instructed groups are In- 
variably superior. In most cases the magnitude of 
these differences is absolutely large and beyond mere 
statistical significance. This Is illustrated by the 
Yact that when comparing frequency distributlonsfor 
each composite Index, the fiftieth percentlle of the 
Instructed groups typically falls around the seventy- 
fifth percentile for the control groups. 


Another way to gauge the degree of educational 
significance of a tiaining effect is to compare the 
level of perfor mance of instructed and control chil- 
dren of differing :Q levels. In thls connectionithas 
been found (Covington, 1965; Covington, 1966b) that 
the mean performance of instructed children with 
1Q’s below 99 (mean JQ = 91) is ona par with the 
mean performance of control children wiuose IQ's 
fall between 100 and 115 (mean IQ = 10%), This in- 
dicates that the -drminlstration of the GPSP makes 
for a substantia: boost in the performance of low IQ 
children over a wide variety of test problems, many 
of which are curriculum relevani. 


To determine how long these training effects per- 
sist, a follow-up test battery was given five months 
after the administration of the posttest in two differ- 
ent studies. These follow-ups included approxi- 
mately 80 percent of the fifth-grade childcen from 
the original samples who by this time were in sixth- 
grade classrooms with new teachers. Wnerever 
possible every precaution was taken to insure that 
the students did not recognize the tests as a part of 
the earlier work, For example, tne children re- 
corded thetr ideas on regular school paper, rather 
than in a standard booklet of the kindused in the 
original study. All the tests were administered by 
the teacher herself, and whenever possible were in- 
troduced as part of the regular classroom work. 


Tn the case of tests of problem-solving ability, 
the instructed children continued to surpass their 
control counterparts on the various ferformance in- 
dices, and although the margin of differences had di- 
minlshed somewhat as compared to the magnitude of 
effects found at the time of the original posttest, the 
difference were nevertheless found to be statist.- 
cally significant. The picture !s not as consistent 
for the tests of creative thinking. Inone sample 
with atotalof 108 children, the inscructed group was 
superlor to the contro] group, whereas In another 
slightly la‘ger sample these differences washed out. 
It appears that after a five-month Interval the train- 
ing effects are at best marginal in the case of crea- 
tive thinking tests. This is not surprising when it 
fs realized that as a group these tests represent a 
type of problem not directly trainedfor in the GPSP. 
Consequently they would de more likely to reflect a 
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greater diminution in tralning effect than would the 

tests of problem-solving ablilty which are more di- 
rectly amenable to the kinds of strategies taught for 
orlglnally, 


ISSUES OF VALUE AND 
JUSTIFICATION 


One of the most fundamental questions raised by 
the present research is whether programs designed 
to promote creative thinking are actually needed, 
seen In the perspective of a child’s total educational 
career. No matter how beneficial a given teaching 
program may be, lt is Ilkely that untutored children 
(the so-called controls) will sooner or later catch 
up, simply through the normal process of intellec- 
tual maturation and accumulating experience. Inthe 
present data the sizable reductlon jn the magnitude 
of the tralning effect {lve months after the adminis- 
tration of the GPSP supports thls contention. Of 
course, it can be argued that more permanent - and 
in thls sense rnore meaningful — changes will occur 
only on an accumulating basis, andthat what is 
needed is a program covering a whole school year 
or even longer, consisting of interlocking, coordl- 
nated curriculum unlts which bulid on one another. 
It remalns a moot point, without empirical support, 
yet lt would seem likely that a long-range program 
of increaslng scope anc complexity designed to stlm- 
ulate intellectual growth would allow the instructed 
child not only to maintain a performance superior- 
lty, but actually to increase thut margin as the pro- 
gram proceeds. While lt is true that the trained 
and the untrained student allke enjoy a natural ex- 
pansion of intellectual cayacities, there is grave 
Goubdt that the untutered children would ever make 
use of their burgeoning capabllltles to the same ex- 
tent a8 would children who received s;stematle long- 
term training. And, as we have seen, since most 
elementary-schoot children make scant use of their 
present capacitles for creative thought, there is llt- 
tle reason to believe that these same children at a 
later age would spontaneously draw on their capac- 
ities to any greater degree. 


A related point concerns the developmental 
changes 1n attitudes and values which favor ‘he ex- 
ercise of creative thought. While it is quite .lear 
that sheer proficiency in various cognitive skllls 
such as question asking or idea generation is a func- 
tion of age, there is as yet no evidence that the rel- 
evant attitudes and values increase as the child 
grows older. Thus, even though untutored children 
may in time overtake the trained children in terms 
of sheer proficlency, they may be markedly defi- 
Cient in the very attitudinal dispositlons necessary 
to put such skills to meaningful use. In this connec- 
tion, creativity training can be designed fo provide 
the student with experiences he is unlikely to re- 
ceive anywhere else — the challenge of working on 
a complex but meaningful problem or the sense of 
satlafaction at discovering a solution - experiences 
which may affect the child’s emerging set of values 
and attitudes regarding creating functioning. Such 
experiences, if they occur at decisive points in the 
individual’s development, especially in childhood, 
may be sufficient to bring him ,2rmanently past a 
critical threshold for actualization of his crealive 
potential, As a matter of fact, we may find in the 
last analysis that the key to the unlocking of creative 
potential is to strengthen setsof attitudes and values 


which predispose the stucent to undertake creative 
tasks In the first place, rather than to start by In- 
creasing hls sheer competence for performance by 
means of ‘skill training. ” 


FUTURE RESEARCII PLANS 


Research plans for the immediate future take two 
main directions. The first of these involves further 
development and expansion of the GPSP. In one in- 
stance a set of supplementary exercises is being de- 
veloped to provide additional practice onthe varlous 
skllis and strategles taught in the lessons. These 
exercises are primarily for remedial purposes and 
can be used when needed, dependlng on the rate of 
progress of the individual learner. Another project 
concerns the development of a set of ‘‘curriculum- 
llnk-units,’’ that is, lessons designed to Illustrate 
how the student can apply the skllls and strategles 
taught for in the GPSP to hls actual school work in 
science and the social studles. 


The other maln direction of research Involves 
the development of new self-Instructional teaching 
units which introduce the student to domains of cre- 
atlve thinking other than problem solving. One ob- 
viously important area 1s that of creatlve understand- 
ing, Here, typically, one is confronted witha series 
of complex events or occurrences which in the inl 
tial phases of investigation often appear to be unre- 
lated. The task is one of discovering meaningful ra- 
lationships between such events andin some In- 
stances of predicting how these events would co- 
vary under various conditions. Inthe case of prob- 
lem solving defined in a more traditional fense, the 
search is typically of a more limited nature — that 
ef discovering a single workable solution-!deawhich 
satisfies a certain requirement, but often without 
the necesslty of understanding why It works. Such 
a pragmatle emphasis tends to make for “losure 
once a solution is obtained. On the other hand, cre- 
atlve understanding not only encompasses the dis- 
covery of workable ideas, but more often involves 
an ongolng procedure of checking and re-check!ng 
the validity of the proposed solutions agzlist an ac- 
cCumulating set of facts and information. 


Another area of creative output, perhaps the one 
most generally ass:med when reference is made to 
creatlvity, is that of creative innovation. Here the 
indlvidual invents or creates new problems, new 
systems of thought, or new products which did not 
exist previously. One example of a prototype training 
unit presently being developed involves the creation 
of a school play. The story-line concerns some 
malicicus daniage done to a barn owned by a local 
farmer and the farmer’s unwarrented accusation 
that a certain boy is responsible. The boy, who is 
innocent, ls able to convince his classmates of this 
fact, bit is unable tu prove it to a degree that satls- 
files the farmer and the rest of the adult community. 
Understandably the children react with indignation, 
but at the same time they reallze thelr essential 
helplessness at being unable to defend adequately 
their interests in an sdult world. While some of the 
children make plans to track down the real culprit, 
others decide to express the group feeling of ineffec- 
tuality and frustratlon by means of a play. Paren- 
thetlcally, such a plot can be used to lJlustrate that 
there are other alternatives to the expresalon of 
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one’s emotions besides direct aggresslon and that 
Intense feellngs can serve as a basls for the devel- 
opment of useful and satisfying products. The par- 
tlcular theme -the plight of thewrongfully accused - 
was chosen because It sounds a note of high drama 
and arouses immediate interest and sympathy in 
children who typically havea keenly developed sense 
of fair play. Moreover it represents - even when 
placed in such a slmplifled context - one of the en- 
during lssues of man and society whichde mands 
new solutions from each succeeding generation. 


The same general pedagogical devices are used 
here as inthe GPSP. The student is led to develop 
the play in a step-by-step sequence, while thinking 
of his own ideas and being provided in turn with ap- 
propriate feedback and redirection of hls efforts. 
In the early lessons the child works through se- 
quences dealing with the creation of the baste plot. 
The student is encouraged with the assistance of 
identification models in the story to generate 
ideas which Seize on the malicious incident asa 
polnt of departure from which to explore the more 
general implicatlons of being wrongfully accused. 
Thls is In conirast to the more pedestrian and com- 
mon- place approaches of simply dramatizing the 
boy’s lnnocence or holding the farmer upto ridicule, 
Basic to the success of th’, teaching sequence I|s the 
introduction of metaphor lcal and analogical modes 
of thinking. Once such concepts are grasped by the 
student he Is able to go far beyond a strictly literal 
interpretation of a situation and can generate a vir- 
tually limitless set of implicatlons. 


After the outlines of a clever insightful plot are 
secured, the studert explores a number of detailed 
matters, all of which are important totheflnal prod- 
uct. In one lesson he creates ldeas for the most ef- 
fective scenery and staging, given a Ilmited amount 
of material to work wlth; Ln another he is called on 
to create segments of the dialogue. The last lesson 
in the series simulates the public reaction to the 
play which represents a final confirmation of all the 
preceding activities. Various members of the audl- 
ence Including the farmer and the parents of the ac- 
cused boy react to the play. There is general rec- 
ognition that lt was worthwhlle in its own right as 
well as being helpful in clearing up a community 
misunderstanding. 


FINAL PARADOXES 
AND DILEMMAS 


Inherent in any attempttoteachforcreatlve func- 
tioning are a number of dilemmas and paradoxes 
which give rise to both methcadological and theoreti- 
cal difficulties. In conclusion we will consider ene 
recurring dilemma, nr: wecause it is necessarily 
representative or even the most fundamental, but 
rather because lt indicates s methingof the extra- 
ordinary challenges encountered In developing teach- 
ing materlals for fostering complex cognitive proc- 
esses. Basic to the act of teaching is a guidance 
function. To a greater or lesser degree the stu- 
dent’s behavior is necessarily guided, shaped, and 
redirected by a teaching authcrlty. The student 
never has complete freedom. He is exposed only to 
certain learning experiences, in certain teavher-de- 
termined sequences. He |s encouragedto talk abot 
these experiences in only certain ways, using pre- 
arranged kinds cf terminology. If we teach for 
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creatlve functloning, then the child will Inevitably 
be subject to some form of guidance. To the extent 
that an educaticnal theory stresses the ‘‘disclpline 
component” of creative thought, any forthcoming 
curricula wlll be more or less restrictlve and pre- 
determined. How then can we reconcile these pro- 
crustean-like features of teaching with the fact that 
in the last analysis creativity ls primarily charac- 
terized by Lmaginal frecdom and a spontaneous Ind!- 
viduallzatlon of thought? Perhaps the answer, most 
simply put, is to teach for structured spontaneity. 
One technique adopted for this pur pose and em- 
ployed In our current work is to give the student di- 
‘rect practice in discriminating among ideas which 
are both unlque and approprlate to a given task and 
ldeas which are merely blzzare. In such a fashion 
the student learns to Ilmit the reachescf hls sponta- 
neity. Another technique which requires a relatlve- 
ly long term training program Involves comprehen- 
slve guidance in the early phases of lezrning. But, 
as the child becomes more proficient In the various 
skills and strategles, the rigid guidance of the pro- 
gram is gradually reduced. In this manner the stu- 
dent comes ultlmately to rely onhis own resources 
and initlatlve with only occaslonal redirection from 
the program. As the student becomes more self- 
eufficient he can experience yet another dimension 
ol intellectual independence — that of deter miningfor 
himself which of several creative tasks he will work 
on from among a number of alternatives. For ex- 
ample, in the case of the creatlve drama unit just 
described, the child could be giventhe option of 
elther writing diatogue or of developing the scenery 
and staging, once he had completed the Introductory 
units. 


All the foregoing Lmplles a complex catering to 
the individual differences of the learner; first, anin- 
tensive close-knit and personalized guidance of the 
chlld In the early phases of learning and later, en- 
couragement of self-c!-ection and self - determina- 
tion. In Soth cases the training environment must 
be capable of selecting, s2quencingand coordinat Ing 
a great many combinations of material. This im- 
mediately suggests computer-asslsted teaching. The 
self- instructional format of the current and proposed 
teaching programs is admirably suited to a computer- 
assisted operatien. Indeed, anotherfacet of t. 2 
work of the Berkeley group is that of adapting the 
GPSP for acomputer presentatlon, thus by- passing 
the cumbersome booklet for mat with Its limited feed- 
back capabilities. With computer assistance the 
child can be guided through a much more Individual- 
lzed sequence of learning; dictated by his Initial lev- 
el of competency, his particular cognitive styie, and 
his individual rate of progress. Conceptually, it may 
appear that cormputers and programmed flnstructlon 
are antithetical, perhaps even perversely so, to the 
task of promoting creative thinking. However, such 
an unilkely juxtaposition points to the kinds of lmag- 
inative responses whlc> -ne educational communlly 
must make to the challenge of educating individuals 
{n an increasingly complex and demanding world. 


FOOTNOTE 


1, The research reportedin this paper was supported 
by a grant from the Carnegie C.. poration of 
New York under the direction of the author 
and Dr. Richard &. Crutchfield. This paper 
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covers research conducted through 1%... Sum- 
maries of our more recent research activities 
can be found in Olton, et. al., (1967) and Olton 
and Crutchfield, in press. 
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meas Measuring Motivation in 
Culturally Disadvantaged 


School Children 


ACOLLEAGUE of mine recertly 
spent a semester in seventh grade (Smith and Geof- 
frey, 1965}. In a school servingacultura)ly disad- 
vantaged neighborhood, he tried to attend class 
every day and played the role of anonparticipant ob- 
server. His account of this experience is very dis- 
couraging to a person who is primarily interested 
in human motivation. Take, for instance, one sim- 
ple incident: 


Harry had been over at the confectioner” 
across the street, and had come out with the 
cest of the boys on Tuesday, when a fight be- 
gen on the playground. There had been con- 
siderable excitement and Mr. Inman (tie 
principal) was trying to calm everyone down. 
Harry had left his pen over in the confection- 
ery and wanted to go h- * across the street 
to get it. Mr. Inmar .10 told him to wait for 
afew minutes, A little while later, he asked 
the question again and was toid to wait. Then, 
or on the third time he hart asked and was 
turned down and told not tn bother Mr. Inman, 
Harry walked off and made a muttered and in- 
decent comment. This was the end of it for 
him. 


This commonplace incident in itself {s minor and 
deesn’t carry the impact of the whole report where 
such Incidents cumulate. It can be taken, however, 
as illuetrative. The utter futility of the situation is 
striking. This and other incidents make it clear 
that the children feel powerless to controltheir own 
destinies. Asa result of their futile attemptstoas- 
sert their initlative in inappropriate ways, they cre- 
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ate an environment wheve even the tecchers and ad- 
ministrators are forced to act in ways that are not 
of their choosing. The resuit is a constant struggle 
between pupils and the school staff to obtain the up- 
per hand. Teachers searchfor waysto enhance 
their power to contry} the behavior of pupils, and 
the children use every means at their command to 
subvert the authority of the school, the last-resort 
being hostility through passive dependency. Both 
parties to the sitvation are ultimately pawns in the 
hands of the powers beyond their control. 


Two more or less disconnected things stand out 
for me in approaching the problem of motivation in 
school children. First, the tangled webof influ- 
ences will not yleld to any miraculous new insights 
or techniques. The Gordian knot is real and will 
only yield very slowly to modest and patient efforts 
to unravel one or two threads at atime. In this age 
of crash programs, imminent breakthroughs, etc., 
motivation is an important concept to consider, but 
we must not expect it to solve all problems. 


The second thing that strikes me is that one of 
“he loose strands that may have potential for unray- 
eling both practical and theoretical aspects of the 
knot is the notion of powerlessness, which is, after 
all, a motivational concept. 


What I have to report then, is no breakthrough, 
but rather a modest beginning that attempts to dis- 
cover whether certain aspects of motivation can be 
measured in a population of culturally disadvantaged 
children, and whether some of the motivational con- 
cepts akin to powerlessness Can be used. 
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Actually we will discuss three different but re- 
fated things. Firet, I will present some notions 
about powerlessness and what I will call the ‘‘Ori- 
gin-Pawn’’ yariable and discuss very briefly some 
relevant laboratory studies that we have c.mpleted, 
Second, I will shift to a discussion of achic vement 
motivatiou and some of the conceptual and scaling 
difficuities that it presents. This 1s necessary in 
order to introduce a third section dealing w.th data 
on the achievement motive inculturally disad- 
vantaged children. These three sections may seem 
a bit disjointed. What holds them together (s the 
relationship between the concepts to be presented in 
fection one and the achievement motive. atthe 
present stage of the research there is little to re- 
port on these concepts except lzboratory studies, 
but we do have evidence on achievement motivation 
from culturally disadvantaged children. Asa rcsult, 
I have more or less arbitrarily put the two together 
with a discussion of some theoretical problems with 
the measurement of achievement motivation. 


POWERLESSNESS AND THE ORIGIN- PAWN 
VARIABLE 


In the anecdote related above, Harry was frus- 
trated by his powerlessness to influence an impor- 
tant aspect of his life vis-a-vis a school official. 
He was a pawn to forces beyond his control. In 
much of his experience in life, and especially in 
school, he is, infact, and is expectedto be, a pawn. 
Learning seems to demand that he react to outside 
influences in the school, and oe way to insure that 
he will react in the proper manner is to reduce his 
freedom to a minimum, to force him to study, to 
press him into the mold expected by the school. 
Techniques designed to do this demand thatthe teach- 
er and the school have most of the power and that 
power be taken away from the student. 


Motivationally there is something wrong with this 
picture. The student, caught up in a power field, 
will do everything he can do to break out of it, and 
when he leaves school, be wili be out of it. Is the 
goal of teaching to produce certain responses in the 
school that are almost certain to be a function of the 
specific power situation and, therefore, not trans- 
ferred to non-school situations? Or is there a 
broader goal? 


We would like to distinguish between the driven 
or power-induced school behavior, and behavior 
motivated from within the student that willcarry 
over to extra-school behavior. The belief that the 
latter is possible reduces to anaive assumption that 
we all make in our everyday interaction. The as- 
sumption Js that each individual has some autonomy 
and exercises it by orlginating his own behavior. 
Let me use the one word ‘‘Origin’’ to connote a per- 
son who is perceived to be originating his own be- 
havior. A person 1s not always an “Origin.” Often 
we percelve his behavior as stemming from a force 
field so that he {s coerced to behave inacertain way 
by an external source. In such cases, I shall refer 
to him as a “‘Pawn’’ or as acting like a ‘*Pawn."” It 
should be clear that pawn-type behavior is induced 
by lack of power on the part of the pawn. Origin 
type behavior implles a feeling of power, although 
it is not entirely complementary in this respect to 
pawn-type behavior. Pawn behavior implies power- 


lessness, but origin behavior implies freedomof 
choice, not necessarily the ability to wield power 
over others. 


Having sketched the ‘‘Origin-Pawn’’ dirnension, 
let us note that it is essentially a phenomerological 
given in the perception of behavior. As such, it may 
be a myth or a mental way station, to use Skinner’s 
railroading metaphor. To extend the metaphor, we 
might say that the main line of behaviorism runs no- 
where near this way station, and efficient operation 
of the line would suggest that the station should be 
dropped. In fact, scientific psychology has been at 
pains to discredit the assumption that a human being 
can be the ultimate origin of some of his behavior. 


Behaviorism, cuffering under the strong influence 
of operationism and physicalism, has done its best 
to reduce the concept of motivation in psychology to 
something of the order of ‘‘the study of the causes 
of behavior.”’ The trouble with this approach Is 
that trying to elucidate the concept of motivation by 
means of the concept of cause is ifke trying tounder- 
stand the behavior of a human being using concepts 
found to ve inadequate to explain the behavior of bil- 
ltard balls. The precept that all scientific state- 
ments must be based ultimately on statements about 
physical operations has great merit, but the hidden 
implication that explanations of physical motion (in- 
cluding behavior) are reducible to the laws of me- 
chanics has seriously retarded the development of 
theories of human motivation. 


Stripped of its hidden assumptions, the neo-be- 
havioristic approach to motivation as the cause of 
behavior is unacceptable to anyone and has never 
been Seriously held by anyone. It assumes that the 
human being is like a biliiard ball and his behavior, 
like that of the bail, is entirely the result of exter- 
nal sources forcing him to behave. Another object 
hits him and steers him in a certain direction ~ an 
explanation that would account for certain trivial be- 
haviors on the football field perhaps - or an exter- 
nal noxious stimulus repets hii like one negative 
charge repels another, or an internal condition 
(e.g., drive-stimulus) produced by external circum- 
stances (e.g. , food deprivation) drives himinacer- 
tain direction. 


Confronted with the phenomena of motivated be- 
havior which in this framework appears akin toa 
sudden Inexplicable movement of a billiard balt rest- 
ing alone on a perfectly level table, psychology has 
irgenfously devised many schemes to explain this 
untoward behavior in terms of Some mechanisms 
involving a causal chain of events and ultimately re- 
ducing to some undetected source of physical energy 
closely connected with, or actually residing in, an 
impelling stimulus (e.g., the cue ball). The cue 
ball, or impelling stimulus, has been variously 
described as a need or drive (Hull, 1943), a drive- 
stimulus (later Hull and Miller), incremental stim- 
lation (Mowrer, 1960), or an affective stimulus 
(Young, 1961; McCleiland, 1951). 


In the face of all this theorizing based on what 
Gilbert Ryle (1949) would call a para- mechanical 
myth, !t seems to me that Skinner has done the 
most consistent thing for a strictly empirically 
based “‘science of behavior,’’ - namely to shun the 
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notions of causality and motivation altogether. Al- 
though I suspect that he may have led some to hide 

their motivational and causal notions under the con- 
cept of reinforcement, his strict adherence tothe 

definition of a reinforcer as something that In- 
creases the probability of a response does, in fact, 
rid the science of behavior of ali of these irritating 
problems. 


By now, J hope to have laid the groundwork so 
that two conceptions of man as a motivated being 
areclear. The first is the one we use inour every- 
day dealings with human beings: namely that the 
cause or reason for a person’s behavior {s sought 
first within him. More often than not, he is the or- 
igin of his behavior and is to be heldresponsiblefor 
it. The second is the explanation from. scientific 
psychology that reeks a physical source external to 
the person, or at least a stimulus within him, that 
drives him. This latter notion has never been sat- 
isfactory in accounting for the ph :nomena of human 
motivation and has, through its emphasis on demon- 
strating a physical basis for all behavior, led to a 
psychology of learning and motivation that con- 
celves of the animal and the human being as a pawn 
to be manipulated by reinforcement schedules. 


Accepting at face value the psychological fact that 
people perceive themselves and others as origins in 
most instances is, for me, the starting point ofa 
truly psychological approach to motivation, and de- 
mands a level of analysis quite different {rom the 
causal chain analysis that attempts to reduce the ex- 
planation to physical events. I have tried, there- 
fore, to build on the assumption that the or Igin-pawn 
dimension makes a difference that is measurable in 
the behaviox of a subject. 


The origin- pawn dimension has its roots in the 
concept of locus of causality used by Helder (1958). 
His emphasis is on the perception of causality, and 
the result is that the concept is applied in the area 
of person perception. In perceiving another per- 
son's hehavior, we do attempt to assess whether the 
locus of causality is internal or external to the per- 
son, and this distinction affects our perception of 
the person, the characteristics that we attribute to 
him, and the way we behave toward him. 


Several person perception studies have demor- 
strated the significance of attribution of locus of 
causality (Thibaut and Riecken, 1955; Pepitone, 
1958). In our own research, we have demonstrated 
(deCharms, Carpenter, and Kuperman, 1965) that 
subjects clearly do use the origin- pawn variable in 
thelr perceptions of others. We found that the per- 
ceptios of a person as an origin or as a pawn is a 
function of several varfables, suchas whether some 
agent is atteinpting to Influence the person’s behay- 
lor or not. Origin or Pawn perceptions are a func- 
tlon of characteristics of the influence agert, such 
as whether it [s a large group, a simall group, or an 
individual, and whether it !s liked or disliked by the 
person. Most interesting, however, was the finding 
that a personaHty characteristic of the subject 
strongly affected his perception of another person 
along the origin- pawn dimension. Subjects were 
measured on a scale developed by Rotter, Seeman, 
and Liverant (1962) that attempts to measure the 
general feeling of powerlessness or efficacy of the 


person. Since Rotter uses reinforcement 
terminology, he calls the scale a measure of control 
of reinforcements and names it the I-E scale stand- 
ing for internal or external control. There isa sub- 
tle difference between this concept of control of re~ 
inforcements and our O-P dimension, but for now 
the similarities may be noted. Our data showed 
that subjects who reported on the Rotter I-E scate 
that they felt in control of thelr sources of reinforce- 
ment perceived other people more as Origins, 
whereas Subjects at the other end of the I-E scale 
perceived other people more as Pawns. 


Since our primary Interest is motivation, we next 
asked the question: ‘‘What effect does feeling like 
an Origin, as opposed to feeling like a Pawn, have 
on the pe:son’s own behavior ?’’ With this question 
we moved from the perception of others to the per- 
ception of self as an origin or a pawn. Two labora- 
tory studies (Kuperman, 1966; deCharms, Dougher- 
ty, and Wurtz, 1965) were devised that attempted 
experimentally to induce the person to feel like a 
pawn in one situation and like an origin in another, 
and to measure the effects on their behavior. The 
results confirmed the influence of the origin-pawn 
variable as manipulated in tho experiment. Subjects 
building a tinker toy model under origin conditions 
that attempted to induce a free atmosphere, as com- 
pared to building a similar model under pawn con- 
ditions 2) liked the origin model best, b) became 
more involved, c) chose to continue the or igin mode] 
when interrupted, d) completed the origin model 
more elegantly, and e) recailed the nonsense name 
given the origin model more frequently a monthafter 
the experiment. Apparently, the origin- pawn dimen- 
sion can be manipulated in a way that has strong ef- 
fects on behavior. The Rotter I-E scaie was admin- 
istered to these subjects also, but was not related 
to any of the dependent variables, either directly or 
in interaction with the origin-pawn manipulation. 
Evidently, this questionnaire measure relates to 
other questionnaire responses as in the previous 
study of person perception, but doesn’t predict be~ 
havior related to a tack situation, at least for the 
male subjects used here. 


ACHIEVEMENT MOTIVATION 


So far our work on the Origin- Pawn varlable has 
not ventured very far out of the laboratory, and we 
have very little empirical evidence about the varia- 
ble in culturally disadvantaged school children. 
What we do have, however, js preliminar7 evidence 
about the measure of achievement orientations in 
this population, and some evidence that one of the 
aspects of achievement orientation involves acting 
liko an origin. Let us be clear that Iam not eguat- 
ing acting like an origin with having high n Achieve- 
ment. What 1 am doing is looking for a relationship 
between the two concepts, and since I am just launch- 
ing a project to attempt to measure the O-P variable 
and n Achievement In schools, andalready have data 
on n Achievement, I wiil report the data in hand on 
n Achievement and speculate about the O-P variable. 
The connection is closer than may be apparent. 


McClelland (1961) has spelled out several aspects 
of what he called the achlevement syndrome, L e., 
ch-racteristics of people wlth high achievement mo- 
tivation. One of the most important aspects is that 
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the achlevement motlvated person likes to take per- 
sonal responsibility for his actions. He likes tc be 
ina position to act like an orlgln and ayoids sltua- 
tions where he is a pawn. 


Let us shift our emphasis, then, to the measure- 
ment of n Achievement in culturally disadvantaged 
children. First, tet us be very clear about one 
thing. The word ‘‘achievement’’ is a luaded term, 
especially In educatlonal circles. A culture such 
as ours, that has been nurtured on Horatlo Alger 
stories and McGuffey readers, tends to perceive 
achievement motlvation as an uimitigated virtue if 
not ablessing. [f we pull back from thls conception 
and ask what aspect of achievement motivation we 
can actually measure, we may be disappointed. The 
measure to be used was developed about fifteen 
years ago by McClelland and his associates at Wes- 
leyan University, and the subsequent years of re- 
search have told us much about the characteristics 
of people who score high on the raeasure. The most 
appropriate single word to describe the person with 
strong achievement motivation as measured by this 
technique is that he is an ‘‘entrepreneur,’’ typically 
following a business career. Topcreatlve sclentlsts 
are not particularly high on n Achievement, nor are 
academiclans. If you want to succeed in business, 
however, you'd better have high n Achievement. 


The achievement syndrome has three major as- 
pects: 1) personal responsibllity, 2) risk-taking 
strategies, and 3) the use of feedback. The entre- 
preneurial spirit of achlevement emphasizes self- 
reliance, the taking of calculated risks, careful 
planning and checking of progress with constant em- 
phasis on the skillful use of nne’s abilitles. These, 
then, are the dependent variables that are related 
to the measure of achleveme:.t motivatlon. 


What is the measure Itself? Actually, even after 
years of research the original form of the measure 
has not been improved very much and is essentially 
avery crude measure. Originally intended asa 
measure of indivicual differences, it ylelds at best 
a very rough ordinal scale that is most useful when 
collapsed into a high-low dichotomy, or at most a 
high- medium-low trichotomy. 


Before discussIng the weaknesses of the measure, 
let us sketch the procedure for obtaining n Achieve- 
ment scores. The technique involves collecting 
thought samples from subjects under standardized 
conditions by showing a group of subjects several 
pictures, one by one, for a short periodof time and 
asking them to write a creative story about each in 
turn. The stortes are content analyzed wy trained 
coders for instances of Achieve ment Imagery. 
Stories in which one of the characters is concerned 
over obtaining success in competition with a recog- 
nized standard of excellence are saldto contaln 
achlevement imagery. The construct validity of the 
measure is attested by years of research although 
test-re-test reliabilities are often lower than valid- 
ity a (for reasons that we cannot take up 
here). 


Of basic concern to us 1s the question: Does 
this measure have any utility for the measurement 
of motivation in educational settings and specifically 
in culturally disadvantaged areas? Most of the early 


research results were dlsappolnting In thls regard. 
Apparently, n Achievement scores are not very 
highly correlated with school grades or standard- 
ized achieve ment test scores in high-school and col- 
lege students. As a result, educational interest in 
the measure lagged after an early fllrtatlon, but it 
has recently been revived by the evidence that it is 
possible to change the motive by tralning. Before 
we get dazzled by the thought of changlng motlves in 
education, we should try to understand the relation- 
shlp between n Achievement and school behavior. [ 
think there are good reasons to believe that the 
measure has been mlsappiled but that it, or aderlv- 
ative of lt measuring the O-P variable, may be very 
valuable for education. 


This misapplication of the n Achlevement meas- 
ure stems from the two most basic levels possible: 
a lack of understanding of the theoretical basis for 
the measure, and lack of clarlty about its scaling 
propertles. 


The problem of understanding the theoretical ba- 
sis for the n Achtevement measure 1s formidable. 
Exactly why there should be a relationship between 
the cantent of stories written by a subject in a one- 
half hour period and many other manifestations of 
his behavlor, particularly school behavior, {s still 
a problem shrouded in mystery. Iwill spare you 
a discussion of several explanatory attempts that 
have becn made and present one based on the notion 
that the measure gives a sample of thoughts of the 
subject. 


Let us be very simple-minded and concetve of 
thoughts as a type of response, arbitrarily remove 
them from the ghostlike realmiofthe mind, and rele- 
gate them to the more prosaic realm of the physical 
world of behavioral events. After all, then Achieve- 
ment measure is actually based on observable re- 
Sponses, rot on pure thoughts. From thls point of 
view, thought samples are a measure of one domaln 
of responses that we wlsh to correlate with other 
domains. Notice in passing that we have made no 
assumptlons about a causal chain, that thoughts are 
antecedent to or ‘‘cause’’ behavior. We have a habit 
of thinking that thoughts precede actions but there 
ls very little evidence to substantiate it, and in the 
realm of achlevement motlvation, there is some evi- 
dence that the behavior may precede the thoughts 
(McClelland, 1966). 


The definition of what constitutes an achlevement 
thought is critical in predicting what behaviors wlll] 
be associated wlth such thoughts. The scoring man- 
ual (Atkinson, 1958) identifles achievement thoughts 
by the term Achievement Imagery and says they can 
be seen in a story when one of the characters shows 
concern over competition with a standard of excel- 
lence. The character can show competition when 
any concrete goal is at stake, such as winning a 
race, getting a good gra 2, becoming a success in 
a career, building a better mousetrap, and 80 on. 
The non-specifIcity of the goat of achievement be- 
havior leads us to the scaling problem mentloned 
earlier to which we shall return, but let us pursue 
a little further the theoretical basls for the measure. 


Thougit - sampling is based on an assumed corre- 
lation between thoughts and more concrete behavlor. 
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The advantage of using a sample of thoughts rather 
than some other type of behavior is this: of all be- 
haviors, thoughts are least subject to inhibition. If 
we seek a measure of what a person wantstodo, we 
need to rid it of restrictions as to what he can do, 
For this and other reasons, thought- samples stand 
a chance of giving us a better picture of a person’s 
generalized motives. 


In attempting to measure what a person wants to 
do, we must follow quite a different road from that 
taken in measuring what a person fs able to do. Put 
in another way, the measurement of motivation ls 
quite different from the measurement of intelligence, 
ability, or even attitudes. We want to know what a 
person wiil do, not what he can do, although the lat- 
ter may form a limit in any particular circumstance. 
In measurlng motivation, we sample his thoughts 
under neutral conditlons: not when he is pressured 
and a pawn, but when he can originate some of his 
own behavior. By definition, in sucha situatlon, we 
cannot have control of the kinds of responses ob- 
served. If we tlghten control, we lose the abillty to 
measure what he will do on hls own and end up with 
a measure of what he can do when we pressure him. 


This paradoxical measurement situatlon [s more 
or less unique and doesn’t fit very nicely into some 
of the most bageic conceptions of scaling. To make 
this a little clearer, think of Skinner’s distinction 
between operants and respondents. Roughly, a re- 
spondent is a response that we can elicit directly ky 
manipulation of a specific stimulus. We more or 
less directly produce a response In the organism by 
external manipulation. Salivary, pupillary, and eye- 
lid responses are examples. An operant is quite 
different. Although Skinner assumes that this type 
of response is probably elicited by some stimulus, 
we don’t know and may never be able to know what 
it is, so we cannot control the response through the 
eliciting stimulus. Ignoring control by reinforce- 
ment for the time being, we measure an operant by 
observing its spontaneous emissionunder conditions 
of relative freedom. 


Let us now conceive of thought sampling as meas- 
uring the rates of spontaneously emitted thoughts, 
i. e., as the measurement of operants. Here we 
launch Into new territory. While Skinner is primar- 
fly concerned with shaping a specific operant and 
converting uncontrolled behavior into behavlor that 
is under the control of the experimenter, we are 
concerned with measuring a generalized class of op- 
erants in the realm of thoughts and relating thie 
measure to other more concrete behavior patterns. 


Thie leap ralses many problems, but the major 
methodological problem {is that our measure of a 
generalized class of spontaneously emitted thoughts 
cannot Fe assumed to result in a conventlonal scale 
characterized by transitivity along an intensity 
dimension. Let me try to illustrate this: Pictures 
used to ellcit thought samples from which n Achieve- 
ment scores are derived show a variety of charac- 
ters, for instance, a high-school student, two inven- 
tors, some businessmen, etc. In what sense cana 
person (A) who writes achlevement stories about in- 
ventors, doctors, and businesszen and attains a 
high score be said to be higher onn Achievement 
than another person (B) who writes an achievement 
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story about a high-school boy but not about inventors, 
doctors, and businessmen and receives a relatively 
low score? If we observe many types of behavior in 
many situations, we may assuime that person A will 
show more general achievement behavior than per- 
son B. But if we measure only school behavior, the 
reverse may be true. li an unpublished study, we 
have demonstrated that a six picture measure of n 
Achievement derived from a standard set does not 
meet the criterion set by the Guttman technique for 
unidimensional scalability (Stouffer, Guttman, Such- 
man, Lazarfeld, Starr, and Ciaucen, 1947), 


Does this mean that the measure is simply unre- 
Hable? I think not, although it does mean that it is 
net a unidimensional measure of the intensity of a 
motive to do a very specific thing and, therefore, 
should not be expected to relate to or predict rather 
specific behavior, such as that expected on a stand- 
ardized achievement test taken under conditions that 
produce respondent, or at least discriminated oper- 
ant, rather than spontaneously emltted operant type 
behavlor. It would be nice to be able to measure 
motivation along an intensity scale, and most of mo- 
tivation theory influences us to think of motivation 
in terms of intensity concepts suchasneed anddrive. 
If we think back for a moment to the dlscussion 
of the Origin- Pawn dimension, however, we can see 
that a generalized measure of what a person will do 
when not forced may come Closer to our concept of 
motivation than an intenslty measure of what a per- 
son can do when pressured. 


In the book presenting the original development 
of the 1 Achievement measure, McClelland, Atkln- 
son, Clark, and Lowell (1953) brlefly mentioned that 
the technique measured the extensity of Achieve ment 
thoughts in a broad realm rather than the intensity 
of such thoughts. This mention har apparently been 
lost in the flood of research, most of which was not 
careful to note the the distinction. 


As suggested above, a careful analysis of the ba- 
sic process involved in the measurement technique 
gives some insight into the lowcorrelations between 
n Achievement and academic performance. It gives 
us more. 1} think it gives us the basisfor suggesting 
that n Achievement scores will be related to much 
more general response patterns. Since the measure 
taps thoughts about achievement in several areas, if 
a person who has many such thoughts is observed 
over a perlod of time in which he may be confronted 
with some of these situations, we should be able to 
predict that he wlll react in achievement ways more 
often than not. In view of the analysis, it may be ex- 
pected that the measure of n Achievement will be 
more valuable in relation to cultural orientations 
(McClelland, 1961} and long term career patterns of 
indlviduals, than in predicting specific responses 
such as school achievement or exam-taking behavior. 


One example may be cited. McCtelland (1965) re- 
ports that of the original sample of subjects tested at 
Wesleyan in the validation proceduresforn Achieve- 
ment fifteen years ago, large numbers liave gravita- 
ted toward entrepreneurlal business occupations 
subsequent to graduating from college. A check of 
the alumni directory indicated that 83 percent of the 
men who could be classified as entrepreneurs now, 
had high n Achievement scores as sophomores in 
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college. Only 21 percent of those classified as non- 
entrepreneurs had high n Achievement. These re- 

sults indicate that n Achievement predicts career 

patterns over a crucial period of life when career 
choices are belng made. 


When it comes to measuring motivesinculturally 
disadvantaged chilccen, we have a lot to learn. The 
data that I have to report results from a study that 
was initially intended to answer some of the most 
rudimentary practical questions such as ‘*Can 
thought samples be collected from this population, 
i. e., Can they produce scorable stories under 
standardized conditions?’ If it turns out that the 
thought samples are scorable, we can ask whether 
the n Achlevement score is valid for this populatlon. 
Is the score, for instance, related to risk-taking 
strategies in this populationas it is in middle-class 
high-school and college students? Since we were 
interested in beginning to probe the Origin-Pawn 
dimension in this population, we cought an existant 
measure that would give an estimate of the children’s 
relative feelings of powerlessness. Inshort, we 
tested the feasibility of collecting thought- samples 
and found fifth, sixth, and seventh grade disadvan- 
taged children quite capable of producing scorable 
stories. We devised a risk-taking situation that had 
the bonus of providing us with a measure of school 
skills, and we used a measure of powerlessness. 


The subjects of the study were ninety-four Negro 
children in two fifth and seventh grade classrooms 
in one large city (sixty girls and thirty-four boys), 
and 120 Negro children from several sixth grade 
classrooms in another large city, Bothsamples 
were taken from school areas known to be the most 
culturally disadvantaged in each city. However, 
since we were primarily interested in testing the 
feasibility and validity of the motive measure, we 
did not sample meticulously, nor did we carefully 
assess the comparability of the areas. For thie 
reason, cOmparisons between the two samples are 
dangerous. 


THE MEASUREMENT OF ACHIEVEMENT 
MOTIVATION 


After introductory remarks, the children were 
handed a six- page form with a different cue typed 
at the top of each page, and four standard questions 
equally spaced on each page to help them complete 
thelr stories. The verbal cue was read aloud (e.g., 
‘‘Two men are working at a machine.’’), and the 
children were given four minutestowrite their 
stories, In all, six stories were required, 


These stories were content analyzed by the pro- 
cedures described by McCtelland, et al. (1953) by 
two independent scorers. Interscorer reliability was 
approximately 90 perceat agreement between scorers, 


THE MEASURE OF POWERLESSNESS 


The children’s form of the measureof powerless- 
ness (Bialer, 1961) was administered immediately 
after the nieasgure of achievement motivation, Twen- 
ty-three statements are presented in simple lan- 
guage and the child circles either ‘‘Yes’’ or ‘‘No” 
indicating whether he agrees or disagrees with the 
statement. For example, one item was, ‘‘Does it 
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ever help any to think what you will be when you 
grow up?” 


RISK- TAKING BEHAVIOR 


In a game situation in whichthe person can 
choose to shoot for a fixed target from varying dis- 
tances of increasing difficulty with increasing re- 
ward attendant on success, a group of high-achieve- 
ment persons will tend to take more shots in the 
middle range, avoiding both easy and extremely 
hard shots. A similar group of low-achievement 
persons will take more shots inthe easy and ex- 
tremely hard positions (cf., Atkinson, Bastian, 
Earl, and Litwin, 1960). The range of risk which 
may be considered a moderate risk is dependent up- 
on the skill of the indlvidual and is evidently chosen 
in terms of where he thinks he has a moderate 
chance of success (cf., deCharms and Davé, 1965). 


We rejected the simple game situation most often 
used. Instead, it was decided to attempt to develop 
a new situation completely analogous to the game 
utllized in our earlier work but involving the typical 
schoo] behavior of children, i, e. spelling and arith- 
metic skills, 


SPELLING AND ARITHMETIC SKILLS 


Each of these measures was comprised of sixty 
items divided into six levels of difficulty of ten 
items each. Spelling words were taken from stand- 
ard lists calibrated for difficulty, and arithmetic 
problems were taken froma series of arithmetic 
textbooks used in the schools from early elementary- 
grade level to junior-high-school level. Extensive 
pretesting was used to assess empirically the valid- 
ity of the various levels, and to assure ahighdegree 
of success for all children in the easiest level, and 
increasing difficulty up to a level where little suc- 
cess could be expected from any child. 


These measures were administered by standard 
classroom procedures. The items were arranged 
in blocks of six, each block progressing from the 
easiest to hardest level of difficulty inorder, though 
this was not made obvious to the children. It was 
stressed that this was not a test in the sense that the 
children would receive grades, but that they them- 
selves would learn from this about their own skill, 


After all children hac attempted all sixty items, 
the various tevels of difficulty were explained to 
thera and their own ability at each level was im- 
pressed upon them by pointing out how many they 
had completed correctly at each level. 


SPELLING AND ARITHMETIC RISK-TAKING TASK 


After the group session, the experimenter met 
with each child individually. She made sure that he 
understood the various levels of difficulty In the 
sixty items he had attempted, and how many he had 
completed correctly at each level. 


The child was told that he would now take atest 
in which he could choose each time the level of diffi- 
culty of the item which he would attempt. It was 
made clear that the test items were dlvided into lev- 
els comparable to those of the previous skill task. 
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Before he was presented with each item, he was to 
choose the tevel of difficulty which he would llke to 
attempt on thattrial. The objectwas to attaln 
‘*coints,'' the significance of which was left unex- 
plained, as inagame. The points that could be won 
by correctly completing the item increased wlth the 
level of difficulty of the itemchosen. These points 
were established for cach child separately, accord- 
ing to the empirically established level of difficulty 
for him. Thus, a skillful child who chose level five 
(a difficult level), and who had done four out of ten 
Items correctly 9t that Jevel in the skill-task (em- 
pirical probability of success equals . 40), stood to 
gain thirty-eight points if correct. A less skis’’ul 
child choosing the same level ftve may have done 
only one out of ten Items correctly at that level in 
the skill-task (c mpirical probability of success 
equals .10). Such a child could win 150 points if 
correct at levelflve. (This procedure, developed 
by deCharms and Davé (1965), equates subjects as to 
skill and einphasizes choices in terms cf the child's 
own Chances of success.) 


Each time the chikd chose a levelforthe «xt item 
(of ten spelling and ten arithmetic items), he was 
asked to consult b's own paper from the skill-task 
and report how many he could expect to get right 
out of ten (his probability of success at that level). 
He was then asked to concult the following table and 
report how many points he could win. The point 
scale was constructed 80 that the number correct 
multiplied by the number of points slways approxl- 
mated a constant (150) as closely as possible without 
uaing decimals. The expected value of ten trisis at 
any level, therefore, equals 150. 


Number row right 
ticcemuct 10 8 FTES EDT 


oe ae 


Poteta you get Wright 18 12:19 22 25 99 36 50 75 180 900 


By such means the experimenter made every ef- 
fort to Insure that the child thought of hischoices 
in terms 3f his own perfor mance on the skill-tssk 
and in terms of the possible points which were as- 
signed in sccordance with hisnwndemonstr sted 
skill. 


Each child made ten choices and attempted ten 
Spelling words, recording his accrued points after 
each trial Following this, each child did the same 
with arithe.ntic items. 


RESULT 


Table i presents the mean skill scores On arith- 
metic and spelling tasks by sex and level of achieve- 
ment motivation. You will note that (he means for 
the high n Achievement subjects are higher fn all 
cases than the means for low n Achievement sub- 
jects. The differences tested by analrsia of var l- 
ance are significant in every case except for arhh- 
metic for girls. There isclearty arelattonehipover- 
all between n Achievement level and school ak ills 
as measured by our test. Therelstionship is 
stronger for boys than for giris, but all differences 
are small, a fact ‘hat Is attr foutable to the low var. 
lances of the acores. The 60-Itemtarck was de- 
signed eo that the majori’y of the subjects would 


success on almost all of the items at the easiest 

level and fall on a'most all at the most difficult tev- 
el. Asa result, the range of probable sco1es its 

much smaller than the total range of sixty, and the 
variances are Guite small. In addition, these re- 
sults come from a sarger analysis whese varlance 

attributable to other factors, such as grade ievei, 
was cxtracted. - 


Table 2 presents data from the same dependent 
variables, spelling and arithmetic skills, but this 
time showing the relationship with the I-E scale. 
The low I-E subjects feel relatively powerless. The 
relationship is significant in both cases of srithme- 
Ue and spelling skills for girls but not for boys. 
This sex difference is more or less the opposite of 
what was found with n Achievement. These results 
seem (to indicate that the though: sample measure |s 
more powerful In predicting school skills for boys, 
whereas the questionnaire measure Is more power- 
ful for girls. The data by themselves are not very 
impressive in this respect, and might seem merely 
afunction of the specific tests except for two things. 
First, we have argued that thought sampling results 
in a different kind of score from that derived from 
a questionnaire, and the difference Is interesting the- 
oretically. Second, a recent review of the literature 
of n Achievement indicates a similar trend toward 
an interaction between sex and type of testing situa- 
tion. Klinger (1966) reviewed some forty-four stud- 
les that investigated the relatlonship between meas- 
ures of achievement motivation and task perform- 
ance. Some of the studies used the thought- sample 
technique which Klinger calls the TAT, and some of 
them used a measure called the lowa Picture Inter- 
pretation Test, or the IPIT. Thistest uses pictures 
but supplies several plots for the subject to choose 
from in 8 multiple choice form. Klinger says: ‘'The 
Studies also suggest an Ixtcraction of Instrument X 
Sex of Subject, in that of the studies thatused the 
TAT, s higher proportion of those with male subjects 
reported significance than those with femsies, while 
the reverse was true with the [PIT’’ (Klinger, 1966, 
pp. 297-298). Klinger makes no attempt to explala 
this interaction. 


tn view of our analysis of thought sampling a8 a 
measure of a more or tess ‘free’ operant where the 
subject emits responses, wheress aquestionniare or 
tnultiple choice measure supplies ready-inade re: 
sponses for the subject tn choose from, it aeems 
reasonable to hypothesize that the free operant mess- 
ure may be more appropriate for male subjects and 
a respondent (or dlacriminated operant) messure 
more sppropriate for femates. {I cannot pretend to 
expiain In detail why this should be a0, but It does 
teem plausiole, especially in the achierement ares, 
snd in our culture, that men are expected to produce 
schievement behavior spontaneously, whereas women 
may have to respond sppeopriately with achlerement 
behavior when pressed bet are nol necessarily 
expected to initiate it om thelr own. We hope to ia- 
vestigate this possibility in the near future. 


The results from the risk-taking dataar  ire- 
sented in Tadles 3 and 4, and maybeseentr ures 
lend 2. The means in the tables need all ce ex- 
glanathm. The bypothesisderitved from eariler 
studies predicts that subjects with high achievement 
ux tivation will more often choose spelling werds of 
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TABLE 1 


MEAN SPELLING AND ARITHMETIC SCORES (OF A POSSIBLE 60) BY SEX AND LEVEL OF 


n ACHIEVEMENT 


Boys 
Math** Speiling** 
High N 46 46 
fn Achievement x 21.7 28, 2 
Low N 51 §1 
nh Achievement x 18.5 21.7 
Total 20.0 24.8 


Girls 
Tetal Math Spelling * Total 
60 60 
24.9 22.5 31.0 26. 8 
63 63 
20.1 19. 6 26.5 23.1 
22.4 21.0 28.7 24.9 


*p. <.05 
*# py, <.01 
TABLE 2 
MEAN SPELLING AND ARITHMETIC SCORES (OF A POSSIBLE 60) BY SEX AND 1-E LEVEL 
(POWERLESSNESS) 

Boys Girls 
Math Spelling Total Math* Spelling * Total 

High N 46 46 69 69 
1-E x 20.9 25.2 23.1 22.6 29.8 26.2 
Low nN ™ $1 $1 54 $4 
EB x 19.3 24.4 21.9 19.0 27,2 23.1 
Total 20.0 24.8 22.4 21.0 28,7 24.9 
*p. <.95 


arlthmetic problems in the middle ranges of prob- 
ability levels from say 30 percent to70 percent 
probability, while subjects with low n Achievement 
will not show this tendency to as greatanextent and 
may, infact, avoi’ the middle ranges and choose 
tore extremes either around 90 percent or 10 per- 
cent. 


tn order to extract a measure from the data to 
test this hypothesis stitistically, we used a proce- 
dure developed by deCharms and Davé (1965). The 
average deviation of the ten probabllity choices for 
each subject is measured around the overall mean 
of all choices for all subjects. A large average de- 
viation indicates that the individual subject's choices 
range farther ovt in either direction on the scale; a 
small average deviation indicates that the subject's 
choices are concentrated ia the middle range. The 


hypothesis then predicts that subjects with high n 
Achievement will have smaller average deviation 
scores than subjects with low n Achievement. Ta- 
bles 3 and 4 present the means of the average devi- 
ation scores from each group. We shall call this 
score the risk score. 


Table 3 gives strong support for the hypothe sized 
relationship between moderate risk-taking and high 
§ Achierement under all conditions, l.e., for both 
boys and girls and when the task involves either 
spe'ling or arithmetic problems. Table 4 Indicates 
that the I-E scale is not related torisk-taking under 
any conditions, 


A look at Figures I and 2 may make the results 
with a Achievement clearer, Figure f combises 
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TABLE 3 


MEAN RISK- TAKING SCORES BY SEX AND LEVEL OF n ACHIF-VEMENT 
(LOW MEAN INDICATES MODERATE RISK) 


Boys Girls 

Math* Spelling*** Total Math* Spelling *** Total 
High N 46 46 60 60 
nAchievement xX 19. 2 24.2 21.7 22.0 23.3 22.6 
Low N $1 $1 63 63 
n Achievement x 23.8 20.1 26. 4 24.4 27.9 26.1 
Total 21.6 26.8 24.2 23, 2 25.6 24.4 
* p. <.08 
seen. <.008 
TABLE 4 


MEAN RISK- TAKING SCORES BY SEX AND LEVEL I-E (POWERLESSNESS) 


(LOW MEAN INDICATES MODERATE RISK) * 


Boys 
Math Spelling 
High N 46 46 
1-E x 21.7 27.8 
Low N $1 51 
1-B x 21.5 26.2 
Total 21.6 26,8 


*No significant differences 


boya and girls and shows a high peak in the mid 
ranges of probabilities of successfor the higho 

Achievement subjects on arithmetic problems. The 
curve for the low n Achievement subjects shows an 
Interesting propensity to take extremely speculative 
tisks. For the low n Achievement subjects 58 per- 
cent of the chokes are in the range of 0 to 40 per- 
cent probability of success. 


Figure 2 presents the resulta for apelling. He: 
the high n Achievement curve shows a hurp in the 
middle, and the low bh Achievement curve actually 
shows a troagh is the middle: tanges and is higher at 
both extremea as predicted by the hypothesls. 


These results with arithmetic and apelling tasks 
show a clearer differentiation in risk-taking strate- 
gies between high and low nm Achievement subjects 
than moet previous etudies in this area, and suggest 


Girls 
Totr Math Spelling Total 
69 69 
24.6 22.7 25.3 24.0 
54 $4 
24.4 23.8 26.0 24.9 
24.2 23.2 25.6 24.4 


the possibility that risk-taking onaserious task 
gach as spelling of arithmetic is moreclearly a 

function of n Achievement than on the gamee like 

tasks used In other studies. R ia also possible that 
the effect of achlevement motivation may be more 
clear ty evident in the culturally disadvantaged envi- 
ronment than in the highly competitive middle class 
culture where the range of n Achievement scores 
may be skewed toward high # n Achierement. 


DRSCUSSION 


All of the results reported from this study were 
cerlved from two different samples that were com: 
bined for simplicity of presentation. When the sam- 
plea are investigated separately, the findings te- 
ported replicate in almost every case, 
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Figure 1. ercentage of tasks chosen at each level 
of probabllity of success on the arithmetic risk- 
taking task by subjects above and below the median 
n Achievement score. 
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Replication of the data on spelling and arithmetic 
skills is especially Important since the tests {rom 
which these scales derived were intended originally 
merely to give preliminary data for the risk-taking 
task. The fact that the relationships with n Achieve- 
ment are significant at allis surprising and even 
embarrassing since the major thrust of our theoret- 
ies] argument peedicts that the n Achievement meas- 
ure should be more highly related to measures of 
change over time than to single teal measures such 
as these arithmetic and spelling skill tasks. Actual- 
ly, the resuks, though significant, are not indica- 
live of high correlations, but of relationships quite 
commensurate with others reportec belweenn 
Achievement and rcademic achieveme’s, Akhough 
we have argued that a Achievement is primarily 
& measure of the extensity of thoughts about achieve- 
ment and should, therefore, de relatca lo long-term 
trends in behavior, our data remind os that a meas- 
ure of extensity is not completely independent of in- 
tensity, Touse the extensity measure exchsivety 
as a measure of intensity is to misappty it; but the 
extensity of thoughts about achlevement may give 
some indication of the intensity of achieremert mo- 
tivation Is a tpecWfic area. 


Probably the most interesting revult of these pre- 
Ilnary forays into the study of motivation la cel: 


Figure 2. Percentage of tas«s chosen at each level 
of probabllity of success on the spelling rish-taking 
task by subjects above and below the median n 
Achievement score. 
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turally disadvantaged children [8 the evidence that 
the thought sample measures are more effective 
with boys than girls, and with the questionnaire 
measure the reverse istrue. if this result etands 
up on replication, it may lead to further insights 
about thought sampling. 


ft should be clear by now thal the !-E acale used 
here was not designed to measure the origin- paw) 
dimension. It is our hope thal a measure of this di- 
mension can be devised based on thought sampling. 
To be valid, the measure must allow the aubdject to 
emit his own behavior. Choice of reactions selected 
and presentec by the experimenter as on a question- 
hatre mits the subject. We areal present beginning 
to develop a measure based on thought samples, and 
peeliminary evidence indicates that It is feasible 
and may be related to the measures of school skills 
discussed here and even to long-term indications 
thal a person prefers to take personal respons ility 
for his actions. 


We can only end this paper by noting that it Is 
only & beginning. The research reported here con- 
stitutes the basis for a project that Is Just getting 
under way, the aims of which are to relate na 
Achievement to change in academic skills tna tongi- 
tudinal study, to develop the concept and measure 
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the origin-pawn dimension, and ultimately to develop 
training techniques for teachers and puplls similar 

to those used in achievement n otivation training 
courses with businessmen (McClelland, 1965), 


REFERENCES 


Aikinson, J. W. (Editor) Motiv: ‘antasy, actlon, 
and soclety. Princeton, Ne. -ersey: Van 
Nostrand, 1958. 


Atkinson, J. W., Bastlan, J. R., Earl, R.W., and 
Litwin, G. H. The achievement motive, goal 
setting, and probability preferences. Journal 


of Abnormal and Social Psychology, 1960, 60, 
27-36. 


Blater, 1. Conceptualization af success and fallure 
in mentally retarded and normal children. 


Journal of Personality, 1961, 29, 303-320. 


deCharma, R., Carpenter, Virginia, andKuperman, 
A. The ‘‘orlgin-pawn'’ variable in person 
perception. Sociometry, 1065, 28, 241-258. 


deCharms, R., and Davé, P. N. Hope of success, 
fear of sailure, subjective probability, and 


risk-taking behavior. vournal of Personaiit 
and Social Psychology, 1965, I, 558-568. 


deCharms, R.. Dougherty, K., and Wurtz, & The 
origin-pawn variable. Unpublished meaq- 
script, Washington University, 1965. 


Hekjer, F. The psychology of interpergon"| rela: 
tions. New tae Wiley, 1958. 


Hull, C. L. Princigles of behavior: Aq introduc- 
tlon to behavior theory. New York: Appleton- 
Century, 1045. 


Klinger, E. Fantasy need achievement as & motiva- 


thonal construct. Psychological Bulletin, 1966, 
66, 201-308. 


Kuperman, A. Relations between differential con- 
straints, affect, and the "‘origin-pawn’’ var- 
fable. Unpublished doctoral dissertation, 
Washington University, 1966. 


r«) 
ERIC 


McCleJland, D. C. Personality. New York: Sloane, 
1951, 


McClelland, D. C. The achieving soclety. Prince- 
ion, New Jersey: Van Nosirand, 1961. 


McCielland, D. C. Toward a theory of motive ac- 


quisition. American Psychologist, 1965, 20, 
321-333. 


McClalland, D. C., Atkinson, J. W., Clark, R.A., 
and Lowell, E. L. The achievement motive. 
New York: Appleton-Century- Crofts, 1953. 


Mowrer, O. H. Learning theory and behavior. New 
York: Wiley. 1960. 


Pepitone, A. Attributions of causality, social attl- 
tudee, and cognitive matching processes. In 
R. Tagiuri and &. Petrullo (Editors), Person 


perception and interpersonal behavior. Ftan- 
ford: Stanford University Press, 1958. 


Rotter, J. B., Seeman, M., and Liverant, 8. in- 
ternal versus external control of reinforce- 
ments: A major variable in behavior theory. 
InN. F. Washburne (Editor), Decisions, val- 


yes and groups. Vol. 2. New York: Macmil- 
n, 1962, 


Ryle, G. The concept of mind. New York: Barnes 
and Noble, 1949 


Smith, L. M., and Geoffrey, W. Toward a model 
of teacher decision-making in an urbar ¢lass- 
room, Cooperative Research Branch. Pro- 
ject 5-048, 1965. 


Stouffer, $. A., Guttman, L., Suchman, E. A., 
arfeld, P. F., Starr, Shirley A., and 
Clausen, J. A. The American soldier: Meas- 


surement and prediction. Princeton, New 

Jersey: Princeton University Press, 1049. 
Thidaut, J. W., and Riecken, H. W. Some deter- 

minants and consequences of the perception 


of soclal causality. Journal of Personality, 
1955, 24, 113-133. 


Youm P. T. Motivation and emotion: A sarvey of 
the dcterminants of human animal activity. 
New York: Wiley, 1961. 


Q- 
ERIC 


PART 1 


quam’ Subject Matter, Content and Sequence 


CURRICULUM improvement in the various disciplines has been ham- 
pered by lack of adequate research paradigins to determine the effectiveness of 
various instructional programs, by lock of relevant learning theory, and by inade- 
quate conceptualizations for determining the content to be learned. The structure 
of the discipline itself, as formulated by one or more scholors, has provided 
much of the basis for recent curriculum development. E. G. Begle in ‘‘Curricu- 
lum Research in Mathematics" cites the extensive work of the Schoo! Mathematics 
Study Group in the develupment and evaluaticen of a mathematics curriculum. The 
siructure of mathematics has proven to be a powerful o-ganizer for the mathe- 
matics curriculum at the university, high school, junior high school, and now at 
the elementary school levels. The point of view adopted is that in learning m--the- 
matics each pupil is to build his own structure of mathematics. Such a structure 
starts with a smull number of concepts and eventually incorporates strategies of 
problem solving. Begle argues that the necessary framework would be charac: 
terized by three aspects: ''1) the matheriatical content of the curriculum, 2) a 
theory of learning of the content, and 3) a theory of the application of the con- 
ten! to problem solving.’ Begle reports that some of the results obtained by the 
School Mathematies Study Group are being investigated in a Nationel longitudinal 
Study of Mathematical Abilities. 

Similar problems of curriculum research and development are com- 
mon to science. Arthur Livermore examines the structure of science (a science of 
science) as the basis for curriculum reform. Reperts of the various curriculum groups 
(PSSC in physics, BSCS in biology, and CHEM and CBA in chemistry) indicate a 
union of scientists, educators. and psychologists working together on the prob- 
lem of curriculum design and evaluation. The evolution of the so-called new 
curriculum in science can be characterized as starting effectively first af the 
high school level, then junior high school, and now at the elementary schoul level. 
While these curriculum studies emphasize concepts of importance within the re- 


spective disciplines, corresponding einphasis is also given to the empirical aspects 
of science as represented in the laboratory activities common to all of the curricu- 
lum studies. For example, the American Association for the Advancement of Science 
has produced a program for the elementary school which emphasizes the process 
approach to science. In this approach certain cognitive skills are used as the or- 
ganizers of the curriculum. However, the lack of an encompassing conceptual 
framework in the science inhibits the development of o systematic curriculum 
K-12. Rather several well-prepared curricula are being developed at the various 
school levels. 

Curriculum development in English is also dependent on the struc- 
ture of that discipline. Robert Pooley discusses various efforis at developing cur- 
ticulum rationales and niaterials in such areas as literature, composition, lan- 
guage, and in the emerging grammars of the English laiiguage. Development and 
research underway in the various areas are reported with sarticular emphasis 
given to the structural and transformational grammars. 

Reading ability is of fundamental concern in the usual curriculum. 
The demands placed on the learner vary across age, and across subject matter, 
yat the student is not trained ‘n techniques of reading science, mathematics or 
English. A research paradigm appropriate to investigating voriation in the rate 
cf reading is reported by Wayne Otto, Theodore Harris, and Thomas Barrett in 
"Research in Reading.’’ The authors investigate the question of ‘whether varia- 
bility in reading speed developed by training with carefully constructed, shor 
model paragraphs will transfer to reading the less tightly structured passages 
typically found in classroom material." Ex:ensive details on procedures and re- 
sults are reported. 

The contribution of psychological research to the development of 
curricula in mathematics is expanding, according to #Ayron Rosskepf. be cites 
the work of various psychologists in discussing the attainment of mathematics con- 
cepts. The effect of the learner's system of focusing on the problem at hand and 
the avuilable strategy of problem solving are discussed. 
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wes Curriculum Research 
in Mathematics 


1 SHALL Interpret ‘‘curriculum’’ In 
the above title very broadly, since 1 believe that re- 
search in mathematics education must invoive re- 
search on the learning of mathematics, the teaching 
of mathematics, problem solving, etc., a8 well as 
the syllabus, and that exclusive concentrationon any 
one aspect of this complex Is not fruitful. 


I shall not attempt ahistorical survey of re- 
search in mathematica education. Weaver (1957- 
1966) has provided useful lists covering research on 
elementary- school mathematics for each year aince 
1951. Brown (1958, 1960, 1963, 1965)has provided 
biennial annoted reporta of researchon mathematika 
teaching carried out vince 1056. A glance at these 
reporta indicates that a considerable amount of re- 
search has been done tn the past and also that the 
volume of research is increasing rapid'y. A more 
careful look, however, providea the melancholy in- 
formation that this large number of research efforts 
yietda very little that can be used to Improve math- 
ematica education. This Is not to say that all these 
efforts have been wasted. There are infact many 
ingenious ideas and auggestions which ought to be 
followed up. tn geceral, though, the results are 
too special or incomplete to be of any wide use. 


Rt doea not take much reflection to see why thia 
should be the case. Research in education in gen- 
eral, and in mathematica education In particelar, is 
much more difficult then retearch in say, peychol- 
ogy or Chemistry. Fo: one thing, the number of 
variables that ahowld be taken into accownt lavery 
large. Mathematica achterement can be affected, 
at leaat in theory, by the peor learninga of the aubd- 
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jects, by awide variety of cognitive abilities and 
cognitive styles, by attitudes toward mathematics, 
ani, a8 we well know, by socio-economk< and demo- 
graphic vaciables. Similarly the cognitive and af- 
fective state of the teacher may well affect the stu- 
Gent's learning of mathematics. 


In order to isolate and compare izodifferentcur- 
rkulum treatments, for example, itisnecessary to 
take all these varlables Into account 80 that the ef- 
fects due to these variables will not be co.founded 
with those due to the curriculum treatments. To do 
this generally requires either a large experiment or 
a large number of carefully correlated small ones. 


Until very recently, it haa been almost impossl- 
bie to meet this requirement. Experimenta in math- 
ematica education have been carried out by Individ- 
uals with limited resources. The experlments of ne- 
cessity were smail in ecale, involved relatively 
amall numbers cf subjects, and had a ahort time 
span. Only very recently bas financial support be- 
come available which makes possible some of the 
studies and experiments necessary for algnificent 
improve ment in math matics education. 


A large scale investigation now being carried out 
by the School Mathematica Study Group is the Nation- 
i tae Study of Mathematical Abilities (Ca- 

f, 196%), 


In thie study three groups of students entering 
gtadea 4, 7, and 10 in September, 1962, tolating 
over a hundred thousand, will have beenfolkewed for 
flve years, The mathematica achievement of each 
of theae etudents has been measured twice erchyear. 
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The primary purpose of this study Isto ascertaln 
the effects of the new mathematics curricula in or- 
der to provide guidance for further curriculum 2e- 
velopinent 


It was necessary, of course, to measure not on- 
ty the level of mathematics achlevement of each stu- 
dent at the beginning of the study, but also as many 
as possible of the other variables which might affect 
the results. We have therefore obtained measures 
of a considerable number of cognitive variables, 
selested by our psychological consultants, for their 
probable relevance to mathematics achievement. An 
extensive atlitude Inventory was administered three 
tlmes during the study, since we want to know how 
attitudes affect achievement and also how achleve- 
ment affects attitudes. We have some information 
about the socio-economic status of the students as 
well as information about the schools. Most of the 
teachers of the students included in the study have 
provided us with extensive information about their 
training and experience. and more than half of them 
have also provided Information about the!. rttitudes 
toward mathe matics, teaching, etc. 


When we analyze this enormous mass of informa- 
tion, we will not only find out what we want to know 
about the differential effects on mathematics achieve- 
ment of modern curricula as Compared with conven- 
tlonal ones, but we wiil also obtaln as a by-product, 
infor mation on the effects on mathematics achleve- 
ment of the other variabtes we have measured. 


This kind of information should prove valuable 
both to the design of future experiments and In the 
interpretation of past results. Hopefully we will 
find that many of these variables have little or no 
effect on mathematics achievement. When this is 
the case, future experiments involving Similar 6tu- 
dents need not take such a variable into account, 
and we will have more confidence it. generalizing the 
results of past studies which did not controlon such 
a variable. 


However, while studies such as thisone will 
prove very helpful, it 1s doubtful that they will prove 
sufficient. There is another fundamental probtem 
which must be overcome before we cau expect sig- 
nificant tmprorements in mathemati s education. 
This provlem is the lack of any throretical frame- 
work for mathematics education. Without such a 
framework, one whose broad outline has reasonably 
widespread acceptarce, there is noway lo program 
the many individual small studles which will con- 
linue to be undertaken so thal they can be mutually 
reinforcing and can contribute to overall forward 
progress. ft is my belief that the time {8s ripe to 
begin the construction of such a theoretical frame- 
work. 


THE MATHEMATICAL CONTENT OF THE 
CURRKULUM 


One aspect of It of course willbe concerned with 
the mathematical content of the curriculum. Before 
discussing this, Iwiliturnto whatmay seem at 
first to be a digression. fam surethat many of our 
teachers look on our now ¢rrricula as a revolution 
in achoot mathematica. Ina sense this is correct, 
but itis merely a amall aspect of a revolution in 
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mathematics !tself which has been going on fora 
century and a half. 


This revolutlon stems from the work of Abel and 
Galois. When Abe] demonstrated the nonexistence 
of an algebraic formula for the solution of the quin- 
tie equation ard when Galois applied his methods to 
settie the general problem, the direction of the de- 
velopment of mathematics was changed forever. Ob- 
viously they did not obtaln their results by time- 
honored computational procedures. Instead they dem- 
onstrated that an examination of the over-all struc- 
ture of a mathematical system, in contrast to com- 
putations with the individual elements of the system, 
was avery powerful mathematical tuol and could 
lead to solutions of problems not otherwise sclvable. 


Although the revolution dates back to the previous 
century, it gathered momentum slowly, and lt was 
only in the present century that Its effects became 
overwhelming. The tremendo.s flowering of modern 
algebra and of functional analysis which started 
early in this Century could not have taken place with- 
out the ideas about structure first pointed out by 
Abel and Galois. 


During the 1930's these ideas began to be applied 
in the graduate curriculum, and it became clear that 
these Ideas, already demonstrated to be powerful 
and indispensable in mathematical research, were 
also powerful and effective ln mathe matics instruc- 
{ion at this level. During the next twodecades a 
start Was made on a revision of the undergraduate 
currkulum in the universities along the same lines. 


Consequently, when mathematicians joined with 
high-echool teachers in an attempt to improve the 
secondary- school Curriculum, their first Inclina- 
thon was to apply to the subject matter normally 
taught in these schools the game puint of view to- 
ward mathematks, an emphasis on structure, which 
had proved successful not only in mathematical re- 
search > * also In mathematical educatton at the uni- 
versily level. When it was discovered that this 
could be done successfully for the secondary- s¢ hool 
curriculum, the reform movement continued and re- 
vised the elementary- school curriculum Inthe same 
Spirit. 


There are two important observations which now 
need to be made. The first is that this revolution 
has been successfuily concluded. The second is 
that no new revolution is clearly in sight. Even if 
the first stirrings of a new revolution might be tak- 
ing place in mathematical research, its effects 
could not appear in the pre-college program for gen- 
erations. Consequently we can agree on the broad 
outline of the contert of the mathematics curriculum 
for the achools. 


This content Is well enough koown that we need 
hot spell it out bere in detall. Suffice it to mention 
that the mathematical topks inctuded In the surric- 
ulum are, with few exceptions, those inchuded inthe 
pre-revolutionary curriculum. Only a few sew 
topics, such as inequalities, have been added be- 
cause of their intrinsic importance, and only a few 
anid topics have been giren lesser emphasis than 

ore. 
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On the other hand, the new curriculum differs 
radicaliy from the old in that it includes the struc- 
ture of the cc...mon mathematical systems, the 
basic mathematical concepts and their Interrelation- 
ships, as we'l as the basic mathematical facts and 
techniques. 


Before discussing the impiications of this new 
aspect of the curriculum for our theoretical framu- 
work for mathematics education, it {s well to polnt 
out that while few new topics have been incorporat- 
ed fn the curriculum go far, there will undoubtedly 
be new ones to be added from time to time. The na- 
ture of our society at present is such that it would 
be wise to include as g00n as possible, and for all 
students, some of the basic ideas of probability and 
statistics as well as someof the mathematical ideas 
relevant to high speed computers. Incorporatlon of 
any such new topic into the curriculum will require 
research to determine the prior understandings 
needed by the student, the most efficient location of 
the topic in the sequence, etc. Wecan certainly 
look forward to a continuing need for this kindof re- 
search 


Returning now to the curriculum, we see thst 
our alm In mathematics education is to help eaca 
student to bulld in his mind a conceptual structure. 
This structure, for primary- schoolchildren, starts 
with a small number of concepls, abstracted di- 
rectly from the real world, about number and geo- 
metric configurations. As the child progresses 
through schvol, these concepls are refined and 
sharpened, and the relationships between them be- 
came increasingly complex. At some stage, new 
concepts are met which come notfrom the real 
world but rather from previously learned concepts. 
The concept of irrational number is a case at point. 
Among these concepts there are, of course, those con- 
cerned with computation. For example, we do not 
ask our eludents (o memorize aninfinite multiplica- 
lion table. Rather, we let them stop after 9>9 and 
teach them the algorithm for multiplication,ardthis 
18 & Concept. 


Naturally, the order in which mathematics! con- 
cepts are learned is sudject to some variation, and 
much research time could be devoted to studying 
the effects of variations in the sequence. However, 
in my opinion, most of this time would be more use- 
fully employed if devoted to some of the problems 
discussed below. 


A THEORY OF THE LEARNING OF THE 
CONTENT 


What this means for us is that our theoretical 
framework for mathematics education must have as 
one of ils many aspects a theory of the leerning of 
mathematical concepts and relations becween these 
concepts, 


No well-developed theory of this sort now exists. 
One's first thought, when the topic of learning of 
any sort Is brought up, is to turn to our Colleagues 
in psychology for advice and assistance. A very re- 
cent eurvey of concept growth in children (Wallace, 
1965) shows that psychologists can provide very 
few useful answers to Caf questions. Muth work 
has been done in this country of the development of 


concepts, but Interest Is usually focused onthe 
strategies used by the subjects in trying to guess 
which combinations of color, sizes, shapes, etc., 
the experimenter has chosen. Neither the concepts 
por the strategies have muchreleyance to class- 
room learning. 


An interesting by- product, however, of these 
Studies is that the availability of verbal labels for a 
concept plays an important role (Kuenne, 1946) and 
wihil have to be faken into account in any theory of 
the learning of mathematical concepts. 


Some of the Investigations of ‘‘dlscovery’’ teach- 
ing in this country have invo!ved the learning of 
some non-trivial mathematical concepts. Unfortu- 
nately, the results of these studies present a con- 
fused picture. For a review of the present state of 
affairs, see Cronbach (1966). 


Outside the U.S., Investigailons of concept learn- 
ing have been dominated by the work of Piaget. He 
deserves great credit, of course, for Investigating 
real mathematical concepts and how children come 
to acquire them. Unfortunately, he generally c on- 
fines himself to the Initial concepts of any branch 
of mathematics and has little to tellus about the 
learning of the later and more refined concepts or 
the learning of relationships between concepts. 


A more fundamental difficulty in spply ing Piaget's 
findings in mathematics educstion lies inthe fact 
that, when he questions a child to see how well he 
understands a concept, he is very careful never to 
provide the child with any subsidiary concepis which 
might heiphim. In fact, he seems to be investi- 
gating what chikiren can learn without the benefit of 
education. There are, however, some indications 
(Kohnstamm, 1965) that the picture is quite differ- 
ent if children are provided with some assistance in 
the form of subsidiary concepts. 


In short, the task of building a theory of the learn- 
ing of mathematical concepts still Iles before us. 
Some ideas about what will have to be Included in 
such a theory can be obtained from the sources just 
mentioned. It should also be mentioned that some 
very interesting work, with which we are just be- 
ginning to become acquainted, is being done in Rus- 
sia, and this work may provideus withfurther clues. 


In order to construct a sultable theory of the 
lesrning of mathematicalconcepts, andsuch a 
theory should ve quantitative rather than purely qual- 
itative, it will be necessary toconstruct instru- 
ments which measure how wella student under- 
stands a particular concept. 


This will not be an easy task. Concepts are not 
observable. MNwill be necessary to use indirect 
methods to assess a student's understanding of apar- 
ticular concept. Perhaps we can obtain some guid- 
ance oa this from our colleagues in the physical eci- 
ences, who slso deal with mobdserrables sech as 
nevtrinos, 


Perhaps the most useful contribution which Pis- 
get haa made to Our present efforts is his demonetra- 
toa that stillfel questioning can provide precise and 
detailed information about an individual's under stand- 
ing of a concept of problem. Similar Individval In- 
terrogations wlll «adoubtedly be an important tool 
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in the development of instruments for measuring un- 
derstanding, although the {inalinstsuments will 
need to appear in a more standardized format. It is 
worth observing that Brownell (1963; also has found 
working with individual childrenaviluable pro- 
cedure, 


THE APPLICATION OF THE CONTENT TO 
PROBLEM SOLVING 


A final aspect of our theoretical framework for 
mathe matics education is that of problem solving. 
It would be futile to provide our students witha 
thorough understanding of raathematics if they were 
not able to use this understanding (to solve problems. 
What we need therefore ls a better understanding of 
how we can help our students todevelopuseful strat- 
egles for solving problems. 


This seems to call for a considerable Amount of 
exploratory work. We do have already, however, & 
variety of problem-solving strategies thatcar be 
investigated. Polya (1945) fo: example, has written 
extensively on this topic. In another direction, 
Newell, Shaw, and Sion (1959) have investigated, 
by means of computer simulation, the power of cer- 
tain specific strategies. These strategies hadteen 
identified as ones actually used by at least some 
students, and a computer program then verified 
that the strategles were indeed effective. Instill 
another direction is the very Interesting work by 
Crutchfield and Covington (Crutchfield, 1966). Using 
comic-book for mat for their materials, they were 
sble to train their subjects to examine the rel tion- 
ships between the various aspects of a problem sit: 
uation, and the implications of these relationships, 
for a sufficiently hong time and in sufficlent depth 
Jo arrive ata solution. Their problems were not 
mathematical, but thelr procedures ‘.ay well Lave 
implications for mathematies education. 


The Russian Ilterature, mentioned above, also 
has suggestinns of problem-solving strategles which 
are worth ir’ cstigating. 


There are still two other sources which may pro- 
vide us with raw material for investigation of prob- 
lem solving. The strategies used by Newell, Shaw, 
and Simon were obtained by having a number of stu- 
dents solve problems aloud during Individual inter- 
views. This procedure may well prove very fruit- 
ful, especially at the elementary school level, where 
we seem to know less than at thehigher levels. 
Similarty, classrooin observations of teachers 
teaching problem solving and of their technique for 
helping students to aolve problems may pay good 
dividends. 


In short, we already know a number of prodlem- 
solving strategies and we have suggestions for lo- 
cating others. What we need to do now is to start a 
systematic study of techniques for teaching these 
strategies to students and of the ability of students 
to use these strategies. We need to study in partic- 
ular the degree of understanding of the conceptual 
structure of mathematics a student needs before he 
can learn a particular strategy and use iteffectively. 
This points wp again the seed for instruments hich 
can be used to measure undersianding of mathe mat- 
kal concepts. 
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To summarize briefly, I have been arguing that 
substantial improvements in mathematics education 
will have to be based on more fundamental research 
than has been carried out so far. I have further ar- 
gued that the magnitude of the task is such that the 
efforts of a large number of research workers will 
be needed and that these efforts can be made mutu- 
alty reinforcing and contributive to substantial im- 
provement only if there ls an overall theoretical 
framework which Is generality accepted and which 
can be used not only to suggest individual research 
problems but also to relate individual findings in a 
meaningful pattern. 


Three aspects of such a theoretical framework 
were mentioned: the mathemalical content of the 
curriculum, a theory of the learning of the content, 
and a theory of the application of the content to prob- 
tem solving. The first is, except for minor varla- 
Uons, dictated by the nature of mathematics itself. 
ht differs from the curriculum content of a genera- 
ton ago by emphasizing the conceptual structure of 
mathematics as well as routine mathematical sklils. 
This part of our theoretical framework, then, 1s gen- 
erally agreedto. The rest however, we will have 
to construct. We have a few bits and pleces to start 
with, but a great deal of empirical work will have 
to be done before even the outlines of these aspe sts 
of our general theory wlll emerge. 


Finally, I have argued that an essential tool that 
we must have to carry out our task isa battery of in- 
struments which measure understanding of mathe- 
matical concepts, and herce thatour first step 
should be that of starting to Construct auch instru- 
ments. 


CONCLUSION 


In conctusion, I should like to note that any frame- 
work we may constrict for mathemati s education 
may be quite specific and not immediately general- 
irabte to other subject matter areas. In mathemat- 
ies we deal with only a very few aspects of the real 
world, namely the numerical and geometric aspects 
of physical situations. In sclence however, for ex- 
ample, many more different aspects of reality are 
considered, e.g., life, energy, mass, acceleration, 
color, density, galaxies, elasticity, genetics, the 
perlodic table. However, as a student progresses 
through the curriculum, his mathematical concepts 
are refined, sharpened, and generalized to a much 
gteater extent than his sclentific ones, so the result- 
ing mathe matical conceptual structure differs mark- 
edly from his scientific one. Hence the process of 
concept formation in mathematics may got be the 
game as in science, and problem-solving strategies 
may have quite different values inthetwo areas. 
And when we move to more remote curticulum 
areas, such as social science or literature, for ex- 
ample. the situation {8 probably even more different. 
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wee Curriculum Research 
in Science 


DEVELOPING and testing new sci- 
ence programs for grades K through 12 hasbeen an 
activity of hundreds of university scientists and 
school teachers during che past ten years. The wide- 
spread and large-scale revolution in pre-college 
science reaching has been possible because large 
sums of money have been avaliable {rom the Nation- 
al Science Foundation to finance the activities. The 
early curriculum reforms came at the high school 
level and these are now well established in sc hool 
systems throughout the country. Because they are 
weil known I will not elaborate on them, but it is im- 
portant to review them briefly because they haye, 
in large measure, set the pattern for science cur- 
rleulum vesearch in the pre-high schoo! grades. 


{iiGH SCHOOL CURRICULUM RESEARCH 


These high-school curriculum projects did sev- 
eral important things. In thefirst place they 
stripped away the authoritarian discussions of mod- 
ern technological advances which had been tacied 
on to science courses that were twenty years or 
more out of date. They adopted the philosophy that 
teaching science was much more than teachingacat- 
alog of facts. Rather, it should be teaching facts 
together with concepts and developing at the same 
time ar. understanding of and an ability to engage 
actively in the scientific enterprise. 


To accomplish these things the approach toteach- 
ing was radically changed. No longer was the dis- 
cipline presented in lecture and in text in didactic 
fashion. No inmyer did the laboratory serve asa 
place where thu student demonstrated to himself 
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facts already known. Instead, the laboratory has be- 
come the place where facts are learned through in- 
vestigation and the classroom the place where the 
results of laboratory investigations are discussed 
and an understanding of fundamental scientific con- 
cepty are developed. 


The Physical Science Study Committee (PSSC) 
led off the revolution in 196. This group decided 
to deal with physics as a unified story in which the 
successive toplcs would lead toward an atomic pic- 
ture of matter, and along with all this they hoped to 
develop the idea that physics is nota book completed 
or closed but is an unfinished and continuing activity. 
They designed new and simple laboratory equipment 
and devised new experiments s0 that the PSSC labor- 
atory became the place where studenta carried onin- 
vestigations, not simply demonstrations. 


Ina similar way, the other high-school curricu- 
lum groups pointed their courses in new directions. 


The Chemical Bond Approach (CBA) project grew 
out of a conference of college scientists and high- 
schoo! teachers held in the summer of 1957. Tho 
group noted that little change had taken place Inhigh- 
school chemistry courses for at least twenty yeas 
and that modern chemical concepts were little men- 
tioned and little used. The CBA group decided to 
make the most fundamental of all chemical concepts 
the central theme of the program. Hence, the idea 
of chemical bonds has become the unifying thread of 
the curriculum. Chemistry is presented agan inter- 
play of experiment and ideas - of what is observed 
and what is thought. In the laboratory program the 
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students carry out small investigations, and inthe 
classroom they learn tc apply chemtca! concepts to 
explain their observations. 


The Chemical Education Materials Study (CHEM 
Study} also stresses observation and concepts. This 
study grew out of the recommendations of an ad hoc 
committee set up by the American Chemical Society 
to consider needed changes in high-school chemis- 
try. The philosophy of the CHEM Study group 33 
that the important concepts and generalizations of 
chemistry should be developed incuctively and that 
the evidence that the students use should be gathered 
by them in the laboratory whcrever possible. Where 
this is not possibile it ts presented by teacher dem- 
onztratlons or films. There is emphasls onthe uni- 
fying concepts in chemistry rather than on great yol- 
umes and varieties of technical applications. 


The Biological Sciences Curriculum Study (BSCS) 
of the American Institute of Biological Sciences 
faced some problems that were more touchy than 
those faced by the physicists and chemists. Tradi- 
tionally, the topics of evolution and of human repro- 
duction had been taboo in high-schooi biology 
courses. Tha BSCS group felt that modern biology 
could not be tavght without introducing these topics, 
and they, therefore, included themin the three 
courses which they developed, Thoughthere has 
been some resistance to these controversial topics 
in a few places, there is now general acceptance of 
the new courses by sclools throughout the country. 
Indeed, it is estimated that this year 80 percent of 
all students taking biology fn the tenth grade are in 
one of the ASCS courses, Though the three BSCS 
programs take different approaches to the teaching 
of binlogy, the goals are the same — to present bi- 
ology as a dynamic and growing field of knowledge, 
not as an encyclopedic catalog of facts. A major 
accomplishment of the BSCS grouphas been to 
change the high- schoo! biology laboratory from a 
place where dead, preserved specimens are dis- 
sected to a place where living organisms are exam- 
ined and experimented with. 


In every case the curriculum groups saw to it 
that the materials were thoroughly tested in class- 
roo:ns before being released for general use. Each 
of the groups prepared batteries of tests to deter- 
mine whether high-school) students could, indeed, 
learn science in these new ways. The results have 
been gratifying. 


One of the important accomplishments of all of 
the curriculum groups has been to bring together 
scientists and teachers to work outthe new pro- 
grams. These ure notcourses ttanded to the 
schools by college professors, but aretruly pro- 
grams that have bean developed cooperatively. 


Physics haa never been a popular subject for 
high- school students, and the introductlon of PSSC 
physics has not stimulated more students to study 
this discipline. There has been concern among sci- 
entists and educators that coJlege bound stwients, {n 
general, should have some experience in this fietd. 
One group having this concern is developing anew 
high-school program which, it is hoped, will encour- 
age non-science majors to take physics. The pro- 
gram, called Harvard Project Physics, adopts a 


cultural anproach. It develops important concepts 

such as force, energy, and motion, but draws heav- 
fly on the humanistle background of the science. 
The pros-am js still in an experimental stage, and 
It remalns to be seen whether it will achieve its 
goal of increasing physics enrollment in high 
schools. 


The immediate short-range goals of the com- 
pleted high- schooi curriculum projects seem to have 
been reached in a satisfactory manner. Through 
tryout and evaluation it ia clear that high-school stu- 
dents can learn science through the medium of the 
new programs. There are some ar as, however, 
where further research remalns to be done. Each 
of the curriculum groups either explicitly or impllc- 
itly suggest that their approaches should develop in 
students an understanding of and an abllity to engage 
in the scientific enterprise, and an interest inand 
enthusiasm for sclence which should carry on be- 
yond the high-school years. Little has been doneto 
determine whether the programs do indeed have this 
effect. A long-range study to evaluate this aspect 
of the new curriculum programs would be desirable. 


Another area which should be investigated is the 
effect of one prugram on another in aschool. For 
example, one might ask whether a student in PSSC 
physics In the twelfth grade does better If he has 
previously had BSCS biology and CBA or CHEM 
Study chemistry than if he has not, The AAAS Com- 
mission on Science Educaticn has plansfor carrying 
out such a Study but the plans have not been imple- 
mented, 


A third and !mportant question ig one of sequence 
of the courses in high school. The curriculum 
groups designed their programs to fit into existing 
slots: biology, tenth grade; chemistry, eleventh 
grade; and physics, twelfth grade. This sequence 
of courses has become established over several 
decades but there is no logical reason for teaching 
the courses in this order, Indeed, when one looks 
at the interrelationships of the disclplines, logic 
suggests that the order should be inverted, Modern 
chemistry is deeply rooted in physics, and inodern 
biology req.ires of the student more thana speaking 
acquaintance with chemistry, The groups whe pre- 
pared the chemistry and biology curricula rec og- 
nized the problem. The chemists were forced to in- 
clude some of the ideas of physics -for example, 
the concept of energy -- in their programs. The bi- 
ologists in tuen, had to include some stmple chem- 
istry In the hope that students would better under- 
stand some of the molecular biology which is in- 
cluded in the courses. The result ineach case is 
not completely satisfactory, and it seems clear that 
some research needs to be done on this problem, I 
shall deal with this later. But now I want to turn to 
the pre-high school years and discuss the develop~- 
ment of sctence curricula there. 


PRE-HIGH SCHOOL 


I said earlfer that the new high-school science 
programs have set the pattern for science curricu- 
lum research in the pre-high school years. The pat- 
tern was set In several ways, including cooperation 
of scientists and teachers in producing the new pro- 
grams, and emphasis on Student activity and 
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and Investigation rather than on didactic preserta- 
tions. As the new high-school currlzula came into 
being, the writers and the teachers who used them 
soon realized that many of the skills and attltudes 
that students reed for effective participation in the 
new curricula should be learned in earller grades. 
Let me take Just one example. The scientlets work- 
Ing with bigh-scheol teachers developing CBA chem- 
istry soon learned from the teachers thatthey could 
not assume that students entering high-sciool chem- 
istry had developed skiils in constructing aiid Inter- 
preting graphs and so a section cf the CBA program 
1s devoted to develuping these abilities. There 
seems to be little doubt that these are skills that 
could be developed in earlicr grades. 


Mary of the scientists who worked on the high- 
schoo) curricula are sow devoting their energles, 
in collaboration with school teachers, {o designing 
and testing scteace curricula for the ezrly grades. 
There are so tnany of these progran.é€ for ele- 
mentary and junlor high school that we cannot exam- 
{ne them all in detall. But we will revlew most of 
the major ones starting with the programs for the 
early grades and telling you in some detail about 
the elementa~y sclence program onwhich lam 
working. 


Each of the groups working at the elementary 
schoo! level have the same general philosophy and 
plan of attack. The purpose of introducing new sci- 
ence p? ograms into the early grades 1s not so much 
to recrult more sclentists as to prepare indlylduals 
to be selentifically literate cltlzens. Literate not 
in the sense of knowing many scientiflc facts, but 
of understanding both the power and the limitations 
of sclence and its iundamental concepts. 


The approaches that the various currleulum de- 
velopment groups are taking to achfeve thls goal 
vary widely. ‘The Elementary Science Study of Ed- 
ucational Services, Incorporated takes the position 
that the child should be introduced to sclesce by pre- 
senting him wlth a variety of materials to investi- 
gate. They have dévelored andtested inclass- 
rooms, units on outterflles, gases and airs, klichen 
physics, microgardening, meal worms, and many 
other topics. Let us luok at the meal worm unit a3 
an example, 


The children are given shoe boxes containing a 
few meal worms and are left to investigate them on 
thelr own. Gradually, as they olserve them, they 
begin to ask questlons. How do the meal worms 
{ind the edges of the box? How do they find their 
food? How do they back up?... and so on. As they 
design experiments to answer their questions, it is 
hoped that they will learn to evaluate evidence based 
on observation, classiflcation, measurement, and 
control of variables; that they will learntoask ques- 
ttons that they can answer by simple tests; and that, 
at the same tlme, they will develop an exthuslasm 
for sclentific investigation. 


The School Science Curriculum Profect of the 
Urdversity of Diinois has a phileeophy similar to 
that of FSS. 


The Science Curriculuza Improvement Study at 
the University of California takes adifferent ap- 


proach. Its maln thrust lstudevelop an urderstand- 
Ing of sclence concepts startlng inkindergarten with 
the slmple concept of ‘‘What is an object?’’ and mov- 
ing {rom there to ‘‘What is a system?"', “What Is 

meent by interaction?’, and soon. Their program 

ls more structured than ESS but stlll leaves room 

for investigation by children. 


Asclence grogram for the early grades is tie 
Minnesota School Mathematics and Science group, 
abbreviated ‘'Minnemast.’' Thls group began by de- 
veloping a mathematics program and then devising 
science units to go along with it, Their science pro- 
gram alms at developing both skills und concepts. 
So far they have seven units for kindergarten and 
first grade entltled ‘Watching and Wonderlng,’’ 
‘Describing and Classifying,’’ “Our Senses, '’ 
‘Shape and Symmetry," “Objects and 1helr Prop- 
ertles,’’ *‘Changlng and Unchanging Properttes,”’ 
and ‘Introduction of Measurement. ’’ 


The project with wii‘ch Iam working ts de velon 
ing a program, called Eclence - A Process Ap- 
proach, for K through grade 6, This curriculum 
development is one ot the act\vitles of the AAAS 
Commission on Sclence Education. Shortly after It 
was established In the spring of 1662, the AAAS 
Commisslon on Sclence Education held two confer- 
ences of sclentists, science educators, and teach- 
ers. Froin these conferences came the suggestlon 
that a frultfui approach to teaching science in the 
early grades would be to devise exercises which 
would develop children’s skllls in using the proces- 
ses of sclence. The Commission elected to carry 
out thls task. Thlg program, which ir now being 
tried out in schools for the third ye2r, is, Ilke the 
other projects, a cooperative effort of scientists 
and school teachers. 


A basic premise of this project 13 that a sclen- 
tlst’s behaviors as he engages in his pursult c.'nst!- 
tute a complex set of skills and 1:. :llectual activ- 
itles but that these can be anslyzed into simpler ac- 
tlvities, and it is these simpler activitles which we 
are Calling the processes of science, Another prem- 
ise is that the individual's ebility to use these varl- 
ou.3 processes can be developed in a step-wise fash- 
ion beginning In the earliest years of schovl. The 
processes for the early grades have been Identified 
as observing, classifying, measuring, communicat- 
ing, inferring, predicting, recognizing and using 
space/tlme relationships, and recognizing and using 
number relationships. For each of the processes 
there is a series of exercises of increasing complex- 
ity and difficulty wnich require the child to engage 
in actlvitles in the classroom rather than to simply 
read or be told about science, 


Let me glve sou a better idea of what the xrogram 
is all about by describing in some detailone of the 
exercises written for the fIrst grade. The exercise 
ls the fourth one in the Communicating process and 
{g entitled, ‘‘Introduction to Graphing.’ [t starts 
with a statement of objectives - ‘‘Tollowing this ex- 
ercise the child should be able to’’: 

1, construct a bar graph, 

2, ‘dentify and name the number of items repre- 

sented by the bars of such a graph. 

3. state the number of items represented by the 

bars and distinguish betweer such expressions 


52 RESEARCH ANI: DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 


as more than, fewer than, the same number 

ee, most, and fewest. 
There is a section called Rationale which tells the 
teacher why graphing is Introduced at thls level. It 
gives her some suggestions about contructing bar 
graphs and also includes suggestlons of how to han- 
dite chiliren’s questlons abuvt why a graph lsuseful 
in communicating Informatlon. 


The activities are Introduced by putting into a 
box a number of colored blocks sy that there will be 
one for each child and so that there will be at least 
three different colors. The teaches then aske cach 
chlid to come and pick a block out of the box and then 
put it into a rough plle on the table so that the blocks 
of each color will be plled together. The teacher 
then aske the children if it is easy tofind how many 
blocks there are of eachcolor. The children, of 
course, find it necessary lo come up tothe table 
and count the blocks in the plles. The teacher then 
asks If they can think of a way of arrauging the 
blocks so that the number can be found more easilv 
and suggests, bf the children de not think of it, that 
if the blocks are plled In vert!cal columns, they can 
be counted easily even from a distance. Tnis leads 
ultimately to the questlon of ways of remembering 
how many blocks there are of each color and into 
the next activity In which bar graphsare first Intro- 
duced. In that actlvity each child agaln selects a 
block and also a felt square and as he putsthe block 
in one of the files on the table he puts the felt square 
ir. one of the columns on a felt board. At the end of 
this activity there ls a bat graph consisting of felt 
squares on the felt board, one column for each co}- 
or of block. In the activitles that follow the chlt- 
dren make bar graphs by coloring squares on large 
sheets of paper and finally are introduced to the Idea 
of a grid and of labeling the vertical axis of thegr Id 
wlth numerals and the horizontal axis with a key to 
identlfy the objects. 


At the end of this exercise ls an Appraisal which 
the teacher uses to determine whether the children 
have developed the skills set forth in the objectives, 
For che Appraisal the children are given objects 
such as toy vehicles of varlous sorts and asked to 
uwace graphs to indicate how many of each type there 
are and then to answer questions the teacher poses 
about the graph - questions suchas: Are there 
fewer cars than motorcycles? Are there more 
trucka than motorcycles? 


You wlll have noted that one of the processes that 
I mentioned is recognizing and using number re la- 
tions. While there were some of the vriters who 
felt that it was not necessary to include number ex- 
ercises in a science program, the maforlty agreed 
that since number skills are required in many ofthe 
other process exercises, we should not simply as- 
sume that the chlid learned them inhis regular 
mathematics program. The exercises in the num- 
beis procegs are not intended tobe a cumplete math- 
ematics program but are intended to supp!ement the 
program already in use in the classroom. 


At the fourth grade we begin to shift gears and 
introduce a new set of processes which are inore 
clearly recogaizable as actlvitles that a scientist 
engages In. These processes are formulating hy- 
potheses, controlling varfables, experimenting, in- 


terprcting data, d2vising modeis, and maklng oper- 
atlonal definltions. We sometimes speak of these 
as the integrated processes because they bring to- 
gether the skills from the earller part of the pro- 
gram. 


One of the advantages of a program in which the 
objectives are stated in behavioral terms is that 
evaluation can be done by assigning the chlidren 
tasks which will indicate whether or not they have 
attalned the expected skills. For example, follow- 
ing the kindergarten exercise In which the children 
learn to identify and to name various plane shapes, 
such 293 Circles, squares, triangles, and rectangles, 
it iss simpte matter for the tuacherto presenta 
child with an array of plane shapes and ask him to 
polnt to a triangle, or the teacher might point toa 
circle and ask the child to name it. The results of 
each task can be recorded with a binary scale. Yes, 
the child could perform tha task, or no, he could not. 
For each exercise we have prepared a series of 
tasks which we call the competency measure. Each 
teacher in our tryout program uses the competency 
measures on a sample of chitdren from her class 
after she has taught each of the exercises. The re- 
sults of this testing In the varlous tryout centers 
are collected and tabulated and used by the writers 
as they revise the exercises during each summer 
writing session. The results give the writers a 
good Idea about the success or faliure of any given 
exercise, 


There sre many aspects of the teaching in the 
classroom that we cannot learn about through the 
competency measure and 50 we ask each teacher to 
glve her subjective impression of the exerclse ona 
feedback form. This Includea Information about the 
tlme required to carry out the instruction, sugges- 
tions of activittes that might b2 omitted or added, 
the reaction of the class, including interest and en- 
thuslasm, carry over of learning to other activitles 
or areas, and attention span. This feedback is also 
helpful to the writing group as the program is re- 
vised. 


Although the emphasis in Science - A Process 
Approach ls on developing skills in using science 
processes It is important to ask the question, ‘What 
about science content?” It is obviously impossible 
to teach process skllls without using content of 
some sort, and the content that we use is drawn 
from various flelds of science. To insure thls we 
{include in our writing team sclentists from all ma 
jo. areas. In the easly grades, of course, there 
are many exercises In which the relationshlp of the 
content to science appears to be somewhat J{stant. 
Learning to recognize pid name two- dimensional 
and three-dimensional shapes isan example. Learn- 
ing to make graphs using colored blocks is another, 
However, as the program progresses into higher 
grades the content [s more and more clearly sci- 
ence. For example, among the twenty-five exer- 
cises in Part Five, which is used in fourthgrade, 
are the following: 

Inferring 8 — Inferences of Patterns in Electric 

Circults 

Defining Operationally 1 - Circults, Conductors, 

and Nonconductors 

Contro}ling Varlables 1 - Growth of Mold on 

Bread 
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Interpreting Data 1 - Gulnea Plg Learning ina 
Maze 

Controlling Varlables 7 - Orlentatlon cf Plants 

Experimenting 1 — Separating Mb:tures 
Of the elghty-one exercises in Parts Five, Six, and 
Seven, the subject matter is approximately as fal- 
lows: physics 33 percent; biology 21 percent; math- 
ematics 17 percent; chemistry 9 percent; psychol- 
ogy and soclal sclence § percent; earth science 7 
percent; astronomy 4 percent. 


JUNIOR HIGH SCHOOL 


We believe, then, that by the end of the slxth 
grade, children going throughthls program will net 
only have developed sufficlent skills tocarry out 
slmple investiyatlons but also will have a store of 
sclentific kiowledge which wlil ake It possible for 
them to embark on a falrly sophleticated eclence 
program in the juaior-high-athool years. What the 
pattern for junior-high-schcol science wilt turn out 
to be is not yet clear. At the moment there are 
four groups who have developed curriculum materl- 
als for junlor high school and tested them ona fairly 
wide scale. Then there are several other groups 
who are at earlier stages of curriculum develop- 
ment. The four programs that are farthest along 
are centered mainly in the physical and earth scl- 
ences ard astronomy. 


The astronomy program, known as the University 
of Dilnois Elementary School Sclence Project, ac- 
tuat'y is designed for the later elementary grades 
and the early juntor-high-school grades. This pro- 
gram is frankly subject matter oriented and con- 
sists of a series of childrens’ books and teachers’ 
guides. The program siarts with the topic ‘‘Chart- 
ing the Universe, ’’ which includes measuring dis- 
tances in the solar system, measuring the size and 
shape of the earth, and using !lghtasatoolfor meas- 
uring great distances. The topics which follow it 
are ‘‘The Universe in Motios,’’ ‘‘ Gravitatlon, *’ and 
‘The Message of Starlight. '' Two additlonat topics 
which are still in prepazation are ‘‘ The Life Story 
of a Star” and ‘‘Galaxies and the Unlverse. ’’ Thece 
matérlals are not intended to serve as a complete 
fcience program fur grades {lve through elght, but 
rather as topics to be included in a broader science 
program. The materials are being tested by sev- 
eral hundred teachers in varlous parts of the coun- 
try but the results of the evaluation have not been 
reporied 


The second program which includes some as- 
tronomy hut many other topics as well, isthe Earth 
Science Curriculum Project which is designed for 
ninth grade. This course was first written bya 
team of sclentists and teachers Inthe summer of 
1964, revised in the summer of 1965, and is already 
being prep red for commercial publication, The 
course, Called Investigating the Earth, is an expex'l- 
ence-centered course in which Inquiry in the strdy 
of natural pienomena is stressed. It consists of 
four unlts - the first one, ‘‘The Dynamic Earth,’’ 
considers tho materlals of the earth, earth changes, 
earth motions, force fields, ard energy flow in 
earth processes. The second unit, ‘‘EarthCycles,” 
considers the hydrologic cycle, climate, and the 
earth's crust, The third unit, ‘‘The Earth’s Past, ’’ 
discusses the measurement of geologic time and 


peleoblology. The course ends wlth a fourth urlt, 
‘Earth and the Unlverse,’’ which begins with a dls- 
cussion of the modu, moves on to the solar system 
and Its origin, and finally to stars, galaxies, and 
cosmology. The program has been evaluated in 
eighty classrooms, and student progress has heen 
determined with a tust on science knowledge which 
ls used both as a pre- and posttest. 


A third junior-high-school program ~- Time, 
Space, and Matter — is being developed by the Sec- 
ondary School Sclence Project at Princeton Unlver- 
sity. This program begins and ends in geology but 
includes a good deal of fundamental physical sclence 
as well. The students Investigate tuples such as 
soluticn, crystallizatlon, and water erosion using 
well-designed equpiinent which is fu. .ished to them 
in the form of Individual kits, 


A good deal of attentlon is being given to eval- 
uating this program to provide feedback for those 
who are rnvising the course. Each teacher keeps a 
dally record of course progress and reports at reg- 
ular Intervals to the project offlce. The teachars 
are particularly requeeted to indicate where stu- 
dents shov’ an extension of knowledge or interest to 
out-of-class situatlons and where they show signs 
of understanding or of confusion as they use the 
course materlale. In addition, the groupis develop- 
ing a test to demonstrate changes in the behavior of 
ehlidren after they have had experlence with the new 
curriculum. Other methods of evatuation, including 
sie instructlonal Interview technique, are being con- 
sidered, 


A fourth program, called Introductory Physical 
Ecience, Is being developed by the same group that 
pr duced the high-school PSC physics course. This 
course also Is intended for ninth grade and is de- 
signed to develop in the students basic attltudes and 
skills that they will need when they later encounter 
the new high-school programs in physics, chemistry, 
and blology. The first two-tilrds of the course con- 
sidexs matter and its properties and leads tothe 
need to assume that matter Is particulate in nature, 
The last third of the course considers the sizeof 
molecules, molecular motion, and energy. This 
course fe laboratory centered, and the group has 
devised simple equipment which permits students to 
carry on significant experiments tnordinary class- 
room. 


It 1o clear as one looks at the new developments 
in ecience curricula for the junior high school that 
we are a long way from a smooth flowing sclence 
curriculum for these graces. There has been little 
or no coordination among the presentcurriculum de- 
velopment projects. As a first step toward cooidl- 
nation the AAAS Commission on Sclence called a 
conference of representatives of the junior - high- 
schoo! curriculum projects in science and mathe- 
matics. The conference was held inJuly 1965 at 
Michigan State University. As the representatlves 
of the projects reported on their work it became 
clear that there was a majcr gap in the Janjor-high- 
school curriculum developments. No group was 
working in the field of biology. The Biological Scl- 
ences Curriculum Study has, for some time, been 
planning to develop a biology program for Junior 
high school, but they have made no progress since 
funds have not been made available to them. 
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At the conference, Bentley Glass and Arnolu 
Grobman of BSCS suggested two possible ty pes of 
junior-high-school eclence programs. One is a tep- 
ical plan and the other a stratified plan. In the top- 
ical plan they suggested that the sclence program 
for grade 7 include about half a dozer toples, such 
as conservation of watler and energy, natural cy-~ 
cles, biologlesl regulation, and homeostasis, An- 
other half dozen topics would be developed for eighth 
grade. These would include change through time - 
cosmolugical, geological, and biological. Another 
group of topics would be developed fos ninth grade 
and would include the broad aspects of meteorology, 
environment, and habitat. 


The stratifled plan that they suggested was as 
follows: 

Grade 7 - physical science - ayear course In 
descriptive aspects, largely earth sciences. 

Grade 8 - life science - a year course in diver- 
sity and unity in the organic world, fundamen- 
tal structure and functlon. 

Grade 9 - physleal science - ayear course in 
basic concepts of matter and energy. 


Another possible approach to an integrated jun- 
ior-high- school sclence program was described at 
the conference by Dr. Robert Jastrow, chairman of 
the Junicr High School Science Subcommittee of the 
AAAS Commission on Science Educat'in. This pro- 
gram would follow naturally from tie elementary 
program, Science - A ?rocess Approach, but could 
also build on the other elementary science programs 
tbat L have already described. The course for sev- 
erth grade would serve as a transition between an 
elen.entary science rogram where the student has 
developed skills In using science processes and 
where he has 'carned some basic science content; 
and the elght) and ninth grades in which the course 
would develo; «coherent picture of man and his 
phye:ical and biological cnvizonment. The seventh- 
grade course, which vuuld be rooted in laboratory 
exp2riences and fleid trips, would consist of selec- 
ted topics from t!.e physica’ and biological sclences 
and from astronomy and the earth sciezces. 


The eighth grade would begin with consideration 
of the basic materials and forces of the universe. 
The neutron, proton, and electron as fundamental 
units out of which all matter is constructed, and the 
basic forces of nature - gravity, electromagnetism, 
and the nuclear forces. The interplay of particles 
and forces would then be used in the discussion 
of the birth of stars and galaxies and the synthesis 
of cheraical elements. The next siep would be to 
consider current ideas about the formation of the 
solar system, nature of planets, and the probabllity 
that olanets exist around other stars. Then geophys- 
ics and geology would be introduced In a discussion 
of the history and present structure of the earthand 
Its atmosphere, and finally the course would take 
up the elements of molecular biology and combine 
this recently acquired biological knowledge with the 
geological discussion of the earth's history inbroad 
attack on the problems of the crigin of life and the 
bivche mical foundations of evolution. 


Vhe ninth-grade courre would treat biology from 
the point of view of evolution. The first topic to be 
considered would be the development of self repli- 


cating cells from primitive catalysts and complex 
organic chemical systems. Then multicellular or- 
ganisms would be discussed and the cimilaritles be- 
tween plant and anima) forms as far as capture, stor- 
age, and step-wise release of energy is concerned. 
Following this, differentlation and embryogeresis 
would be considered and then the molecular, organ- 
ismic, and ecological factors involved in natura) 
selection would be treated. The ninth-grade pio- 
gram would end with a discussion of ‘he development 
of the nervous system and with how the nervous sys- 
tem accuunts for ccnscloucness, ¢crceptior, learn- 
ing, and memory. 


A course of thls sort, in whichcentrai problems 
of modern science serve as the core, should serve 
as a general education course for students who do 
not elect to take much science inhigh school. At 
the same tlme, it should provide a solld background 
of the skills and understanding which would serve 
as an effectlve base for the high school biology, 
chemistry, and physics courses. No work beyond 
planning has been done on this program yet. It is 
hoped that work can begin within the next yerr. 


SCIENCE COURSE SEQUENCE 


Now I want to come back tothe question about the 
sequence of science courses in high school that I 
have already mentioned briefly. One of the argu- 
ments for puttlng physics off until the twelfth grade 
is that the students do not develop the necessary 
mathematical skills until they have reached that ley- 
el. [ have not sald anything about the new math- 
ematics curricula except the relationship of mathe- 
matics to the Science - A Process Approach ele- 
mentary curriculum. There are, of course,sev- 
eral pew approaches to teaching mathematics In the 
schools. In these new programs the students devel- 
op mathematical skilis at muchearller grade levela 
than they have done in the older traditional pro- 
grams. It is possible, I think, that Ly the end of 
the ninth grade, students will have sufficient skill 
in algebra to do the mathematics i: a modern phys- 
ics course such as PSSC. Mathennatlcs skill would, 
therefore, no longer be a block to moving physics to 
an earlier grade, 


If a janlor-high-schooi sclencecurriculum gives 
the student some “undamental knowledge of physics, 
chemistry, and blology and related sciences, I see 
no rezson why physicc cannot be madea tenth-grade 
course, followed by cheinistry in grade 11, and a 
molecular blology course in grade 12, Already, In 
a number of school systems arouna the country this 
sequence is being tried. 


There is another possible pattern for grades 10 
and 11. Since there are a number of topics that are 
common to physics aid chemistry, it is possible to 
interweave these two disciplines into a two-year se- 
quence of physical science. An experiment is now 
under way in Portland, Oregon, to do just this, A 
group there set out three years ago todevisea “‘road 
map’’ through PSSC physics and CBA chemistry and 
a similar one through PSSC physics and CHEM 
Study chemistry so that teachers could move easily 
from one book to the other. The program starts 
with the topic ‘‘Interpreting the Universe, ’’ and con- 
siders fundame-‘al concepts and measurements ard 
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the nature of chemical change. The next section is 
mechanics which is all drawn from the PSSC course. 
The rest of the year is devoted to the electrical na- 
ture of matter, atomic models, and molecules and 
energy. In all of these chemistry and physics are 
interwoven. In the second year of the program there 
is less blending of the two subjects. The course be- 
gins with optics and waves, followed by electromig- 
netles and a discusslon of quantum systems and then 
moves Into ccnsideration of bonds and ct.emlical sys- 
tems; order, disorder, and change; and molecules 
and energy. 


This program has been evaluated using selected 
test Items from CBA, CHEM Study, and PSSC tests. 
The Portland group reports that the combined pro- 
gram Is successful and that even though students 
are permitted to take only the first year if they Ilke, 
a large majority of them stay with it for the fulltwo 
years. At present, this program Isde3lgned for 
grades 11 and 12, but {t could be used at grades 10 
and 11, 


The ‘road map’’ technique is not completely sat- 
isfactory, and there ls need foz a fresh start to de- 
velop an integrated modern physical sclence curric- 
ulum. 


REVIEW OF PROBLEMS 


We have examined some of the recentand current 
science curriculum research and have suggested di- 
rections In which curriculum research might go in 
the future. There are some corollary p: oblems 
that Ihave omltted, We will review these br'efly. 


As elementary science education moves from 
falrly passive learning through books and exposition 
to student manipulation and Investlgatlon, there will 
be an increagirg need to provide supplies and equip- 
mnent for classrooms even as early as kindergarten. 
The amount of money provided for science supplies 
in most school systems is small. It will have to be 
Increased manyfold to accommodate the new pro- 
grams, It is impossible todo more than estimate 
roughly what the cost of introducing the new elemen- 
tary programs would be. It appears that on the or- 
der of $200 per classroom will ke needed to int ro- 
duce the new programs. To assist school systems 
in planning for the introductlon of the new elementary 
science programs, the AAAS CommisslononSclence 
Education is just embarking on a study of the costs 
of equipment and supplies. It is our expectation 
that thls study will be completed shortly. 


Classroom design will also be influenced by the 
new eécience curricula. As a minimum for the early 
grades, classrooms should have multiple electrical 
outlets, running water, and level working areas, I 
have been surprised at the many classrooms I have 
visited that have only a single clectrical outlet. 


Although the new junior-high-school science cur- 
vicula that are now under development are designed 
to he used in classrooms withcut special laboratory 
facilltfes, I think that inthe ftuiure Junior-hlgh- 
school classrooms wili need tobe providea with 
laboratory space similar tothat found in senfor high 
schools. 


A crucial problem ralsed by the new curricula Is 
teacher training. As you know, the senlor-hligh- 
school science teachers have been able toattend 
summer Institutes to learn to use the new biology, 
chemistry, and piiysics courses. A few Institutes 
are now kelng held for juntor-hign-school schence 
teachers, For the elementary schools the problem 
is different both quantitatlvely and qualitatively. The 
science programs for the earliest grades do not re- 
quire that the teacher know a great deal of sclence 
content, but they do require some teacher orlenta- 
tion. Up to now during the experlmental stage the 
various curriculum groups have carried on this or- 
fentation and tralning on an ad hoc basis. In the fu- 
ture, as the programs are more widely used, suhvol 
systems must establish inservice tralning programs. 
It would seem that high-school science teachers 
might be used to staff euch programs, 


And then there is tae problem of preservice 
training of teachers. Only one of the curriculum) 
groups, ‘‘Minnemaat, '’ ls preparing college mate- 
ria} to train progpective teachers to use the ‘‘Minn- 
emast’’ materials. There is a group at Rensselaer 
Polytechnic Institute that l3 designing a new course 
in physical sctence for non-science majors with the 
thought that thls course will better prepare new 
teachers to use the new school science curricula. 


I said earlier that one of the importauat things 
that happened as the curriculum groups organized 
and developed their programs was that scientists 
and teachers collaborated, each learning from and 
educating the other. This cooperation has produced 
needed and significant changes In science curricula. 
Changes which could not have been effectedby either 
scientists alone or teachers alone. This coopera- 
tion must, and J] am sure, will, contlnue, Science 
curriculum research is a cortlnulng activity, and the 
best minds in science and the best minds in educa- 
tlon must be devoted to .!. 
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wee Curriculum Research and 


Development in English 


THIS PAPER is planned to present 
aelected {tems of recent revearch inthe teaching of 
Engiiah from a number of aspects. Together they 
raake up the body of information aud expert opinion 
which will largely direct curriculum work in the 
decades ahead. Although the goal of most English 
teaching ls to accomplish an integration of the com- 
ponent parta of the subject, they are here presented 
in divisions to avoid confusion and overlap. One 
area of research and study often associated withthe 
English language arts is reading asaskill. It is 
omitted from the suryey because in the field of edu- 
cation it is considered separate from the language 
arts. It has iis own courses, {tsownfacilities, and 
a very extenslve body of regearch, only a small por- 
tion of which Is related to the language arts. The 
word ‘‘reseazch”’ has been interpreted broadly 
enough to include mention of seminal books which, 
if not in themselves research, have induced and will 
induce research in the aree.s of their treatments. 


THE PROFESSION 
OF ENGLISH TEACHING 


In 1961 a committee of the Natlonal Counc!) of 
Teachers of English published a document entitled 
The National Interest and the Teaching of English 
with the sub-title A Report on the Status of the Pro- 
fession, In three major parts this document studied 
the pregent situation in the teaching of English, re- 
lated the situation to the national scene, and made 
analyses ami studies leading to specific recommen- 
dations for the improvement of the teaching of Eng- 
lish by meeting recognized needs. 


wmanat Robert C. Pooley 


The University of V isconsin 
Madison, Wisconsin 


The scope of the responsibility of Engiish ladrain- 
atized by a bar chart revealing that of allhigh 
school students in school lu 1960, 92. 9 percent were 
enrolled in English courses, 68 percent in social 
sciencee, 55 percent ii mathematics, and 25 percent 
in feveign languages. A rurvey revealed that 1, the 
years 1958-1959 the demand fur trained high-school 
teachers outran the supply by 27 percent. Ex pand- 
ing schoo) populations will increase thisratio, 
Moreover, the expansion of knowledge 2nd the re- 
quirements of a complex society will increasligly 
demand more technicaltraining ard knowledge on the 
part of English teachers than was true in the past. 
The single greatest weakness in the current situa- 
tion is the lack of articulation in the teaching of Eng- 
lish from the elementary school through college. 


A summary of the highlights of the status report 
follows: 
The Need for Teachers of English: 

a. The shortage of teachers shows no sign of 
decreasing. 

b. One-fourth of all elementary teachers are 
not college graduates, 

c. Only 40 to 60 percent of high-school Eng- 
lish teachers have completed a college ma- 
jor in English. 

d. ‘here is an acute shortage of college in- 
structors in linguistics and composition. 

State Certification Laws: 

a, States differ wideiy {n requirements. 

b. Ten states certify elementary teachers 
without a degree. 

c. Nineteer states have no stated requirement 
in English tor elementary teachers; twenty- 
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one lack definite requirements In reading, 
children’s Mterature, and English methods. 

d. Minimum >reparatlon in English for Eng- 
lish teachers is sixteen to eighteen credit 
hours. 

Preparation of elementary teachers: 

a More than 94 percent of the colleges fall 
to require specific scudy of the English 
language. 

b. Less than half require a course Inthe teach: 
ing of the Jangvage arts. 

Preparation of secondary-school teachers of Eng- 

lish: 

a, Only one-fourth of the colleges require a 
course in the history of the Engllsh lang- 
urge. 

%, Only 17 percent require a course in Modern 
Engifsh Grammar. 

c. Only 41 percent require a course in ad- 

vanced composition. 

. Ouly silghtly more than half the colleges 
require a course in the methode uf teaching 
Eng) lsh. 

Better Teaching Conditions: 

Teachers with a student load of 150 (ive sec- 
tions of thirty students) must work more 
than 50 hours a week just meeting classes 
and marking papers. (In 529 out of 682 
schools, English teachers had five classes, ) 

Libraries: 

a. 10,000,000 elementary, and wbout 150,000 
high- school students attend schools lacking 
a central Library. 

b. The average expenditure for books per stu- 
dent is about half the price of one average 
book. 

Remedial Engiish in Colleges: 

a. An estimated 150, 000 students falled college 
Engllsh tests In 1960. 

b, Two-thirds of American colleges have to 
offer remedial work in English. 

c. The cost of remedial instre-tlonis esti- 
mated to be over ten million dolars, 


c. 


A contlnuatlon of the research into the status of 
the teaching of English was carrled on by acommit- 
lee of the National Council of Teachers of English 
and published in 1964 under the title The National 
Interest and the Continuiny Education of Teachers 
of English. The princlpal purpose of this investiga - 
tlon was to discover and reveal the need for inserv- 
ice education of teachers concerned with English In 
elementary and secondary schools. Questionnaires 
wera answered by 7, 417 secondary-sclool English 
teachers and by 3,030 elementary- school teachers. 


Some high'ights of the analysis are: 

1, Over 40 percent of the nation’s elementary 
teachers began full-timo teaching without a 
degree. Only 31 percent of these achieved the 
degree after beginning teaching. 

2. More than one in ten high-school teachers 
(11.8 percent) began full-time teaching w ith- 
out adegree. Practically all of these earned 
a degree later. 

3. Although 24 percent of instructional time in 
kindergarten through grade 12 is givento Eng- 
lish and language arts, only & percent of the 
elementar? teachers’ college preparation 1s 
given to tais subject. 


4. About half (49.5 percent) of secondary teach- 
ers teaching Engl'sh Jack a niajor in this sub- 
ject. 

5. By their cwn admission only 51.9 percent of 
secondary-school Englsh te:.chers feel com- 
petent In literature; 36. 6 percent feel compe- 
tent in composition, and 53.5 percentfeelcom- 
vetent to teach the English language. 

6, In voluntary continulng educatiwn, elementary 
teachers take one summez eession for each 
eight years of experlence. But the courses 
taken are largely in education, with little or 
no jurther education in the language arts. 

7, Thirty percent of recondary teachers of Eng- 
llsh have not taken a course in English in more 
than ten years, 

8. Interest ir further education for elementary 
teachers was expressed for six aréas: chi’- 
dren’s lilcrature, language, spzech, writing, 
general lIlterature, and the largest nutaber, 
70.3 percent In reading. 

9. Secondary teachers expressed interest in fur- 
ther experience in practical methods of teach- 
ing English: intermediate or advanced compo- 
sition, literature for adolescert:, teaching of 
reading, literary criticism, and structural 
aidl/or generative grammar. 


The broad conclusion is overwhelm’ng evidence 
of inadequate training with a clear need for means 
to make inservice further education avallable to 
nearly all teachers of the Erglish langucge arts. 


Two books of [mportance to the whole profession 
of the teachiug on Englieh appeared in 1963 and 1965 
respectively, The Education of Teachers of English 
(Grommer., 1962" ig Volume V of acurriculum se - 
ries of the National Councli of Teachers of English. 
Written by a committee rcpresenllig elementary- 
school, high-school, and college English teaching, 
it analyzes facts, Implications, and tnferences In 
such matters as the liberal education of teachers, 
the professional education of English teachers, and 
the specific preparation in Englishicself. It con- 
firms the conclusions reached In other studies that 
elt 2ntary-school teachers are very poor ly pre- 
pared to teach English; that the preparation of high- 
schoo! teachers is subject to wide var lations and 
some serious omissions; and that college teachers, 
though perhaps well grounded in content, are often 
innocer.t of any preparation to teach. Much space 
is devoted to recommendations and procedures for 
the continulng education of teachers by means of sum- 
mer sessions, Institutes, evening classes, and uses 
of mass media. 


The second broad area book is Freedom and Dis- 
cipline in English, a report of the Commission on 
English of the College Entrance Examination Board 
(1965). The Commission on English was appointed 
in September 1859, Consisting of sixteen members 
from nniversitles, collegés, and private schools, it 
undertook to defins the field of English, and to set 
standards for instruction in English and in the prep- 
aration of teachers for English. In 1962 it eponsored 
and suppo. ted twenty institutes attended by 868 teach- 
era in all parts of the United States. It commia- 
sionedandissueda series ofkinescopes featuring ex- 
perienced college teachers of English expounding 
their specialties. These kinescopes are lentfree of 
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charge except for mailing costs. The volume Frec- 


dom and Discipline in English Is the {inal ceport of 
the Commission. 


Chief contributions to the curriculuia are: 

1, Recommendatio:s to improve the quallty of 
instruction, 

2. An analysis of language teaching, Ine luding 
grammar and usage. 

3. An analysis of literature teaching, emphasiz- 
Ing the critical process in teaching and study- 
ing kiterature. 

4. Ar analysis of composition, Including valua- 
ble suggestions for m., ‘‘vating writing, and for 
the correctlon, criticism, and measurement 
of writing skill. 


Without essential conflict in fundamental matters, 
lt maz be stated that, in general, the publlcaticns 
of the National Council of Teachers of English tend 
to be experimentai and progressive in outlook, and 
that the peint of view of the Commission on English 
is conservative. Tothe curriculum direstor there 
is great value /% the balance to be derived from 
these differing viewpoints. 


RESEARCH IN THE 
TEACHING OF LITERATURE 


Although most of the studies in Ilterature deal 
with Ideas and values rather than with coi.trolled 
evaluation, some receut studles reveal effective 
techniques for measuring the success of students in 
the learning of kinds of Ilterary muterials. Squire 
(1963) studled the responses of adolescent readers 
to four short stories, establishing their responses 
as forming seven categories: I. Literary Judg- 
rgnts: Direct or implled judgments on the story as 
px artistic work; II. Interpretatlonal Responses: 
Reactions ir which the reader generalizes and at- 
tempts to discover meaning, motlvallon, and the na- 
ture of the characters; DI. Narrational Responses: 
Reporting facts or details from the story without in- 
terpretation; IV. Asr ciatlional Responses: He- 
sponses in which the reader associates ideas, 
events, places, or people with his own experience; 
V. Sel-invoivement: Responses in which the read- 
er associates himself with the behavior and/or emo- 
tions of the characters; VI. Prescriptive Judgments: 
Responses in which the reader prescribes a courre 
ef actlon based on some absolute standard; VII. Mis- 
cellaneous Responses: all] others. 


Wilson (1966) reports the responses of college 
freshmen to the reading of three novels: The Catch- 
er in the Rye (Salinger), The Grapes of Wrath 

teinbeck), and A Farewell to Arms (Hemingway). 
Fifty-fcur freshman English students read a novel, 
took notes while reading, and wrote immediate re- 
actions incliss. After three discussion periods 


they wrote follow-up reactions. This procedure was 
followed for each of the three novels. 


The written responses were coded by means of 
Squire’s (1963) categories. Statistical analysis 
showed that 65. 6 percent of responses to the three 
novels were iaterpretational; 12.2 percent literary 
indgments sclf involvement, 8.9 percent; narration- 
al, 5.7 percent; associational 2.1 percent; pre- 
scriptive 1.3 percent; miscellaneous 1. 3 percent. 


The lead of interpretation over Ilterary judgment ic 
a sign of maturlty of perceytion; lt suggests that 
teachers should avold supplying ‘‘corsect”’ inlerpre- 
tations before the book Is read by the student. The 
study reveals that although students may begin their 
involvement with literature in a groplng and emotion- 
al fashion, their later attempts at interpretation be- 
come shorply formulated and logical. Teachers 
should therefore refra‘n fron: demandlng that first 
reactions be fully descr lbed os defended. But as the 
study of the novel moves into the grappling with dif- 
ficulties, the lastructor should demand expert aaal- 
ysis. Most students are Capable of growth of inter- 
pretatlon by these means. ‘ 


The Research Foundation of the National Council 
of Teachers of Erglich is sponsoring. directing, and 
supporting research In children’s growth in sensitiv- 
ity to, and appreciation of literature. Starting with 
a natlonal conference of elersentary- school, high- 
school, and college specialists tn i{terature aszem- 
bled in Chicago in May 1863, the Foundation applled 
itself’ to research in the teaching of literature be- 
cause so little is being done. It was soondisco\ered 
that there were no /~struments available to measure 
any aspect of success in children’s growth in lltera- 
ture. The Fourdatlon then deter mined to try tu cre- 
ate such tests, both as research In Itself, andasthe 
means to further studies. Following consultations 
wlth various authoritles, tiie Foundation appointed 
Margaret Early of Syracuse University the Director 
of the test activity and appropriated funds tn Its sup- 
port. Inthe summer of 1965, Early asser-blea at 
Champaign, Illinois, some twenty-five selected 
teachere and llbrarians to develop test items. From 
the materials produced by tnis group, and augmented 
by Early’s advisors, fcur forms of a test have been 
developed by cooperative vork with the Ecucational 
Testing Service oi Princeton, New versey. A trial 
run was made of these forms inthe spring of 1967 at 
elementary schools in grade 5 In tocationa covering 
the United States. From the statistical study of the 
returns It is expected that two flnal forms of the test 
will be developed. 


The goal is to attempt to discover growth inthe 
responses of childrer to Jlterary experiences. The 
range is from grade 4 to grade 6, Inclusive. Al- 
though it will oe a pen and paper test, many of the 
tenis will re presented orally on tapes. If the test 
reveals measurable growth in responses to litera- 
ture, the research will continue intwo directions: 
(1) to measure the effectiveness of kinds of instruc- 
tion on the Ilterary growth of children; and (2) to 
creale similar tects for junior-high schools and pos- 
slbly senior-high echools. 


RESEARCH IN THE 
TEACHING OF COMPOSITION 


One of the most exhaustive researches of recent 
tlmes was conducted by Richard Braddcck, Richard 
Lloyd Jones, and Lowe!l Schoer of the Univeralty 
of lowa and p:bllshed in 1963 by the NCTE under the 
title Research in Written Composition. It undertook 
to assess al] known research Incomposition thit 
could be described as ‘'scientific.’"’ From twenty 
bibliographies of research came over a thousand ci- 
tations; committee analysis reduced these to 485 
items. Fromconsultation with seventeen authorities 
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this number was reduced to about one hundred titles; 
later some flfly other titles were added. Afirr vig- 
orous analysis, only flve studles survived the crite- 
ria set up by the Investigators. These five only, In 
the eyes of the Investigaicrs, can be termed valid 

In the teaching of composition. 


1, The Baxton study revealed that thorough crit- 
Iclam of composition by a competent reader, fol- 
lowed by revislon by the student brought better galns 
than writing not crillelzed. 


2. The Harris study showed in & 2-year space 
that the direct (or functional) teaching of grammar 
brought better results than the formal, analytical 
method. 


3. Tne Kincald study undertook to reveal whether 
a single paper written by a student on a given tople 
at @ particular time provided a valid means tojudge 
a student's writing abllity. Joined to this question 
were several others, so thatclear answers were 
almost Impossible to secure because of weakness In 
the structure of the research. 


4. The Smith study dealt with class size asafac- 
tor in the teaching of writing. It revealed thata 
large class of superior ninth-grade students can 
pecegress in composition as well as a small class. 


5. The Becker study compared three methods of 
teaching, described as normal. dibllographic, and 
kincscoype methods. The so-called normal melt.od 
iro tu have a silght ruperlority over the 
others, 


The conclusion of the Braddock Investigations is 
that of the more than a thousand {te ms originally 
noted, only these five may be consikfered to yleld 
valid answers frem sound rese .rch. 


In a review of the Braddock report inCollege 
English, Jean Hagstrom (1964) analyzes (he re- 
search methods employed in these five researches, 
and conchudes, ''It is therefore extremely disheart- 
ening to say that 1) none of them strikes a layman 
aa definitive or percuasive, and 2) there is very lit- 
Ue promise that without rigorous antecedent thought, 
the ‘sclentific’ method applied te composition wlll 
yield bettor results in the future than ithas ia the 
past.'’ He urges antecedent thought on buch tasle 
problems as: How do you find a subdjeci? Howdo 
you clothe it In appropriate style? Howd,. you give 
it effective organization? 


Tte Research Fou-dation of the National Council 
of Teachers of English planned a 1967 conferesce of 
epectalists ir: ® number of felds to attempt to Kea- 
tity tie furdamentals of compos tion. 


Current retearch tr. compcsition has taken an In- 
teresting and profitable direction in applying statle - 
tical procedures to rhetoric. Kellogg W. Hant 
(196$a, 1965) collected large samples 0’ students’ 
writing at grades 4, 8, and 12. These wcre sudjec- 
ted to strectural analysis to attemp? to describe the 
differerces in gcntence sirvcture as students mature, 
As a tool of aralysis Hunt developed what he called 
the 'T-unit'': a group of words minimal in length, 
each terminated grammatically between acapital 


letter and a perlod. This unit has the advantage of 

preserving al] of the subordination achieved by a stu- 
dent, and all of his coordination between words and 

phrases and subordinate clauses. 


His {Indings, very much condensed, are shown 

In Yable 1, This table reveals that the most signif- 
icant mark of maturity Inwriting is not sentence 

length in itself, but the increase of length of the T- 
units. When superior adults writing for Harpers 
and the Atlantic Monthlv were analyzed by the same 
means, the length of their T- units increased by 40 

percent over the twelfth graders’, anincreage equal 
to the gain of twelfth graders over fourth graders. 
Twelfth-grade students came close to the profes- 
sionals in the number of clauses they use; the 
growth among prefessionals Is inthe increased num- 
ber of words per clause. These resuls glveaclear 
indication of the factors to be studied and taught in 

the improveme:.t of sentence structure. 


Franc!s Chrisicnsen {1963b) counted senterce 
openers to provide objective knowledge of how pro- 
tesslonale vegin sentences. High schoolandcollege 
composition teachers have generally encouraged a 
wide varlety of sentence openeis, including prepo- 
sitiona! phrases of all types, purticiplal phrases, 
gerund phrases, absolut? constructions, and sen- 
tence inversions. Cre writer says, ‘When a@ stu- 
dert opens a sentence with an Infinitive phrase or a 
past participle. we Immediately stamp himas mere 
mature..."’ 


Christensen analyzed twenty recent or contempo: 
rary writers - ten of narrative and tenof expository 
writing ~ to determine by what constructions they 
open sentences. The findings are In direct opposi- 
tion to the traditional teaching: the professionals 
place something before the subject In only a fowrth 
of their sentences (24.47 percent); that is, over 75 
percent of their sentences degin with the subject. 
Of those opening by something cther than the sub- 
ject 23 percent of the total sentences open with ad- 
verbial modiflers, 1,17 percent use verbal groups, 
and the Inverted structure appears Inonly one of 
every three hundred sentences (0. 32 percent of the 
total sentences). The excessive use uf verbal group- 
ings as openti's produces a style ¥ hich Christensen 
calls ‘‘pretzel prose'’: that is, twisted seni tnces. 
He concludes: ‘The good teacher should not onty 
base his teaching on the practice of professional 
writers, but should himself practice before he 
preaches," 


In ano’her study Christensen (195$a) develops 
what he calls ‘A Generative Rhetoric of the Sen- 
tence.'’ He presents a echeme forthe purpose 
of ‘buckling down to the hard work of making a dif- 
ference in the student's understanding and manipu- 
lation of langvage."’ From hisown analysis and 
Uthat of others he draws four pri-ciples underlying 
the rhetoric of the sentence: 

1. Composition ls essentially a process of addi- 

tion. 

2 The cumulative centence requires direction 

of modification or direclicn of movement. 

3. Additions are made In levets of generality or 

levels of abstraction, 

4. Density of texture ts achieved by edding frequent- 

ly and mech to nouns, verbs, and main clauses, 


5 ah a opin Rpm seme SS Ss 
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TABLE | 
MARK OF MATURITY IN WRITING 


a a 


Average length Ratio of Average length Ratio of Average 
of clauses clauses per of T-unlts T-unlits per tength of 
T-unit eentence sentences 
Graded 6.6 words 1.30 8.4 words 1.6 13. § words 
77 percent 17 percent 60 percent 137 percent 6O percent 
Grade 8 &.1 words 1,42 11.5 words 1.37 15, 9 words 
04 percent 85 percent 80 percent 117 percent 04 percent 
Grade 12 2&6 worda i, 68 14.4 1,17 16, 3 words 
100 percent 100 percent 100 percent 100 percent 100 percent 


Using visual analysis Christensen shows how sen- 
tences are built (or generated) by the procesa of co- 
Ordination (addition of parallel elements), by gubor- 
dination, taddition of levels of modification) or by @ 
Combination of coordination and aubordination. Ines- 
sence Christensen recommenda and demonstrates 
the superiority of the cumulallve eentence over the 
complex sentence. His techniquecfanalysis can en - 
rich the study of literature as well aa develop ma- 
ture writing. 


Two yeara later Christensen extended his theory 
of the sentence (o the study of the paragraph. Using 
a parallel title ‘A Generative Rhetoric of the Para- 
eteph’’ (Christensen, 10965), he shows that the pein- 
ciples of analysia he developed for sentences apply 
with equal cogency to the paragraph; thal is, para- 
graphs are created by addition, involving coordina- 
tion of elements, subordination of elements, or com- 
binations of thetwo. Aa wellas addition, there 
must be also direction of movement; there wllt be 
levels of abstraction, and carying ceneity of texture, 
In apply ing these pe inciples he formulated them un- 
der nine headings, a few of which are: 

1, The paragraph may be defined as a sequence 

of structurally related senlentes. 

&. The top sentence of the sequence Ia the topic 

sentence. 

4. Bimple sequences are of two sorts: coordl- 

nate and sudordinate. 

6. Some paragraphs heave no top, no tople, aen- 

tente. 
The nine headings are developed by exposition and 
litestration. The conclusion to be drawn Is thal the 
paragraph may be studied and laugh! as the sente xe 
fa studied and Laught by Christensen. 


A. L. Becker (1965) offers a differert analysis cf 
the paragraph under the title "A Tagmemic Ap- 
proach to Paragraph Analysis.'’ A Tagmeme Ia de - 
fined as the shortest gram matical anil; Becker calls 
them spols or slots In a system where substitution 
is aay They are hist piel of Lorm and fane- 
tion. Limiting bis analysts loexposkory raphs, 
Becker finds two fundamental patterns. Tre l rn 
haa three fanctional alota whkh be ladele T Qopte), 


R (restrictions), and 1 (illustration;. These elots 

correspond to three levels of generality in para- 
graphs (cf. Christensen) and reflect anatural way of 
talking or writing about something. 


The second major pattern has two slota labeled P 
(problem) and 8 {sclution}. The P may be aquestion 
or an assertion; the 8 is the answer or re spunie. 
Where the § [8 extended, it tends to follow t.2 TRI 
structure, The majority of expository paragraphs 
fall into these two besic patterns. 


Variations In the patterna are caused by deletion, 
reordering, additicn, and combinatlon. The formal 
markers of Internal tagmemic structure are graphic 
(indentation), lexical (equivatence classes and lexi- 
cal transitions), grammatical (changes in the gram- 
mattal role of equivalence classes signal new slots 
or new paragraphs), and phonological (shifts in pitch, 
register, tempo, and volume in oral reading). 


Thia analysis makes possible the partitioning of 
Paragraphs in a consistent and predictable way. 


The accurate and impartial evaluation of compo- 
sithon is one of the major problems of English teach- 
ing. Paul Diederich (1066) made a study of the fac- 
tors that account for differences in the gradea of 
qualifled readers. Three hundred papera on two 
subjects were read uy sixty distingulshed readers 
repreaenting ale different flelds: Englivh, aocial 
studies, natural ecience, writers and editors, law- 
yers, and business executives. By comparison cf 
the ralirge of three readera who stood highest In a 
particalar f2¢tor wi'h three who stood lowest In the 
same factor, It waa possle to lsolate infivential 
factora. tn all, 11,018 comments on 9,857 papers 
were tabulated. 


The factora revealed stood In this order of fre: 
quency: ideas, mechanics, orgtnization, wording, 
style ct ‘'flavor.'’ For experimentation tn high 
athoola, these were divided into lwo groups: L Gen- 
eral Merit (ideas, organizalion, wording, and f{la- 
vorh; IL Mechanica (usage, sentence structure, punt- 
fealion, capitals. ebbreviations, apelilng, hand- 
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TABLE 2 
DISTRIBUTION OF RATINGS 


ees EE  _$ 


Non-Academle (N = 476) 


Grade 10 (145) 11 (167) 12 

High 5 percent 8 percent 9 percent 
Middle $4 percent S53 percent 63 percent 
Low 6l percent 39 percent 28 percent 


writing, neatness). A rating card was developed 
for the use of evaluators. A close following of the 
techniques developed by Diederich, with a year cf 
practice for a faculty, should yleld a reliability of 
the cumulative total for each student close to . 90. 


In the same article Diederich (1966) develops an 
elaborate but jeactical procedure for the rating of 
large numbers of papers. By a process of sorting 
and grouping of anonymous papers of combined grade 
groups, such as grades 10, 15, and 12, the process 
resulls in precentage figures for selected groups 
like Non-Academic and Academic with significant 
differences for High, Middle, and Low in eachgroup, 
ara a recognizabie growth figure from grade 10 to 
grade 12, This extract (see Table 2) from a senlor- 
high popelation will illustrate the distributionof 
ratings. 


in vh's lower abillty group the progress in the 
highest level is slight but observable. 4 percent. 
The progress in the middle level is striking: from 
34 percent to 63 percent; the reduction in the low 
group is equaily striking: from 61 percent to 2¢ per- 
cent. The figures from the Academic group show 
great advances tn the high and middle level. This 
procedure demonstrsics to teachers, administrators, 
and parents a positive progression of improvement 
not deruonstrable by customary paper-grading 
processes. 


RESEARCH IN 
LANGUAGE LEARNING 


Ruth Srichland (1962) undertock to analyze the 
strufure of children’s oral language Inthe firat 
through the sixth grades, to compare it with the 
sirecture of language found In the texts designed to 
teach children fo read, and to discover, at selectec 
grade levels, the influence of any ostensible differ - 
ences in the quality of chiddren’s reading skill. A 
major hypothe sis was that a sludy of children’s 
speech might offer suggestions for the construction 
of better (extbooks in reading. 


In the enalysis of structure, twenty-five consec- 
utive sentences recorded on tapes were used as the 
language sample for each child. A special scheme 
was devised for the analysis of the language at two 
levels. Level One was divided into ‘slols’” of sta- 
tionary elements, and ‘‘moveables,’ or elementa 
which can Appear in different positions. Level Two 


was concerned with the types of subordinatlons or 
“‘gatellites’’ used in the fixed slots and the move- 
ables. This structure analysis is an important con- 
tribution of the of the study. Tabulations from this 
analysis were programmed to computers to relate 
the frequencies to the variables of age, sex, intelll- 
gence, socio-economic status, and parent education. 
I¢ was found that many aimilar patterns were used 
with great frequency by children of every grade. It 
wes also noted that children of ull levels used a wide 
range of language patterns, and could elaborate and 
expand sentences by the use of moveablesa and sub- 
ordinate elements. 


In the comparison of children’s language with that 
of textbooks In reading, four sets of widely used 
textbooks were analyzed for language patterns. The 
patterns used by children and by texts al relevant 
grade levels were studied. No scheme for contro} 
over sentence structure to parallel that over vocab- 
ulary seemed toexist. This raises the question: 
Can knowledge of the structures used by children be 
used to devise textbooks controlling the difficulty of 
reading? 


A study of the relationship between children’s 
uss of language and the skillthey demonstrate in 
learalng to read in grade 6 revealed that children 
renking high in the variable elements made more 
use of the common ora! structural patterns than did 
children ranking low; the same children also made 
greater use of movesbles and elements of subordi- 
natlon than did children ranking low. Among the 
conclusions to be drawn are thee: 


a. Children’s command of language patterns is 
much broader than is generally realized. 

b. There i8 almost no relationship between chil- 
dren’s oral patterna and the patterns of struc- 
ture In reading texts. 

ec. Children can be helped to recognize the pat- 
terns of excression and by this means be 
aided to advance in reading and in the learning 
of grammar ard usa -¢. 


Walter Loban, of the University of Californla,? ¢- 
gan in 1952 a longitudinal study of children’s growth 
In language which continued for eleven years. His 
report The La e of Elementary School Children 
(Loban, 1965) covers the first seven yeare, the ele- 
mentary achool level. From the Oakland, Califor- 
fia schools $38 subjects were chosen at kindergar- 
ten level and were observed and tested inthe follow: 
ing yeare. Mems especially studied were: their vo- 
cabulary, thelr use of oral and written ianguage, 
thelr proficiency in reading and lietening, teachera’ 
Judgments of their ekill with language, and back- 
grcund information on their health and homes. 


Loban developed what be calls "Use Com munica- 
tion unit’? in analyzing children’s speech. RN may be 
Gelined es a group a! words which cannot be further 
divided without the loss of their essential meaning. 
Another term he developed is ‘the maze,’ aseries 
of words or inillal parts of words which do not add 
up to meaningful communication. Langvage sam - 
pics recorded on disks andtapes provided the 
source materials. Two sub-groups, one exception- 
ally high and one exceptionally low in language abil- 
ty, were Mentified, 
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A large number of specific findings have been 
summarized In the published report a8 follows: 


During the first seven years o: schooling, chil- 
dren speak more words in each succeeding year, 
produce more communication units, and increase 
the average nuniber of words in those units, 


Children rated aa skillful ln language reduce both 
the'r incidence of mazes and the number of words 
per maze. 


Not pattern, but what fs done to achieve flexibit- 
ity within the pattern proves to be a measure of ef- 
fectlveness and control of language at this level of 
language development. 


Children who are rated as most profic lent in lang- 
uage are also those who mantfest the most sensitiv- 
ity to the conventions of language. 


Those high in general language ability are also 
high in reading ability. -. Writing ability {s related 
to sochoecono mic position. . » The highest correla- 
tlon In the study is between vocabulary and intelli- 
gence» ++ A low but positive relation extsts between 
health and language proficlency - - - Competence In 
the spoken language appears to be basic for compe- 
tence In reading and writing. 


An important aspect of language learning In chil- 
dren Is their ability to learn and use standard Eng- 
lish. Loban tn Problems in Oral Engilsh (1946) 
states that for most children & Command of standard 
Engl lsh is necessary, for ‘society exacts penalties 
of individuals who do not possess It.°’ In continulng 
his longitudinal study of children’s language, Loban 
here examines examples of nonstandard oral usage 
among four different groups ol schocl chikiren from 
kindergarten through grade 9. Hischtel ‘ndings 
have been summarized thus: 


In ten years of schooling, pupils from homes In 
which class dialect ts used make almost no impr.ove- 
ment in -:sing the verb lo be appropriately or in 
standardized verb forms. 


The practice, £0 common among weaker teach- 
ers, Of driillng all pupils on the same skiliis not 
supported by this research. Individual pupils, but 
not whole classes of pupils, will need help if they 
are to use the standard forms of trregular yerba, 


As the coraplexity of sentence structure andtcal 
volume of spoken la e both increase, there isa 
more than proportional probability of difficulty with 
ves problems of clazity and precision, not problems 
of haditval osage. 


Almost ail the pupils whose parents speak Infor- 
mal standard English have litle need of drillor. 
usage. 


Oral drill ls more effective than workbook drills, 


THE EMERCAKE GRAMMARS 
AND DIALECT STuBY 
in the last (teen years a fundarertal tenet of 
English teaching, namely, (het there is one gram- 
mat of Engltsh to te learned and taoght, Las been 


blasted by the development of at leasttwoother sys-~ 
tems of English grammar and the reasonable expec- 
tancy of others to follow. It {8 no longer accurate 
to speak of the grammar of English except in refer- 
ence to the complete operation of the English lang- 
uage. We now have several grammars, euch & 5y8- 
tem to deseribe how the English language works, or 
more specifically, how Engilsh makes sentences, 
The traditional system was developed principally in 
the eighteenth century by scholars whose grammat- 
ical disc|pilnes were derived from Latin and Greek. 
Traditional grammar, therefore, was developed to 
make English conform.to structural principles of 
Latin and Greek. Aside from certain classical bi- 
ases, and lack of then undeveloped lingulstic prin- 
ciples, it is a system of analysis of English of great 
value in the past and is by no means obsolete at pres- 
ent, unless viewed as the grammar of English. 


In 1982 C. C. Fries Introduced structural gram- 
mar. He was chief among a number of scholars 
working along parallel lines. The contribution of 
structural grammar Is accurate description: tt Is 
concerned with the detalled elements of a language, 
Its sounds, word units, inflections, and syntax. In 
the latter, analysis ls conducted on the basis of {m- 
mediate constituents as operating in modification, 
predication, complementation, and subordination. 
Structural grammar has greatly eariched knowledge 
about the elements of English andthe manner in 
which they are combined to express meaning. 


Noam Chomsky (195%) of MiT brough! out in pub- 
lished form a new approach to grammar under the 
title Syntactic Structures. Somewhat modified by re- 
vieions, this newest of grammatical theories has 
great promise for the future. Generaliy called gen- 
erative-transformationa' grammar, itis a system 
which attempts to state the “rules”? which generate 
all English sertences ard only English sentences. ft 
assumes that we have in us a mechanism for using 
these tawa which we gain from intulllon. We are 
therefore able to generate sentences thal have never 
deen uttered befc.e. The analysis begins withker- 
nel sentences, simple declarative sentences without 
Gevclopment. From these kernels other sentences 
are derived by means of rules for transformations, 
rules which charge or develon kernel sermences con- 
talning phrase structures which are grammatical 
parts of a grammatical sentence. The goal of this 
hew grammar Is to state the rules that will make the 
feeduction of sentences predictable. 


Applications of structural and transformational 
gtammar for classroom purposes are dereloped by 
Owen Thomas (1965) and Paul Roberts (1964). The 
for mer develops the transformational system ineasy 
stages for the English teacher to understand ard uti- 
lize the processes of generative-transformational 
gtammar in the Instruction of students. The latter 
presents a set of programmed lessons for self-in- 
struction ir. the new grammar. N. 8. Blount (Blount 
and Johnson, 1966) of Madison, Wisconsin, has cre- 
ated a similar programmed series of lessons adapt- 
ed to the eighth grade. 


The following curriculum qoestion arises: ‘What 
happens to students who are taueht the structure of 
English by generative- transformational processes?” 
Bateman and Zidoris (1066) offer a tentative answer 
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as tie result of an experiment withninth-and tenth- 
grade students. Using equivalent experimental and 
control groups, they taught the former by transfor- 
mational techniques and the latter by traditional 
techniques. A valid sampling of free writing of 
each student was collected at the beginning and end 
of the instruction. The analysis of these writings 
by the Hunt (1965b) process revealed thatthe exper- 
imental group wrote better sentcnces of more 50- 
phisticated structure than did the control group, A 
parallel experiment is now under way at Manitowoc, 
Wisconsin, under the leadership of N. S. Blount of 
The University of Wisconsin, Madison. 


A Dictionary of American Regional English is fi 
progress, centered at The University of Wisconsin 


and directed by F. G. Casslay of the Departmentof 
English (1066). Such a dictlonary has been planned 
for over seventy-five years, and active collecting 
has been going on since 1889. Now under a 5-year 
contract with the U. 8. Office of Education the work 
i8 progressing rapidly. Collections of data for six 
stetes, Including Wisconsin are completed; six 

inore are partlally compteted. Work of a similar 
nature ia well under way in eleven more states. 

Mang of the field workere live and work in ‘Word 

Wagons,’ specially equipped small buses contain- 

ing the essentials of Ilving quarters and apparatus 

for fleld collection. 


Data are assembled, classified, and placed ina 
computer {lle at Madison. Collectors record speech; 
readers analyze regtonal literature and local news- 
papers. The effort isto secure complete coverage 
of the words and expressions used differently in var- 
jous areas of the United States. 


Curriculum applications of this study have yet to 
be worked out, but they will Include 1) greater and 
more precise knowledge of American dialects; 2) a 
classification of usage levels and standards; and 3) 
new attitudes toward local and regional language 
variatione. 


WISCONSIN: ENGLISH 
CURRIKVLUM ACTIVITY 


By means of a Federal comract initiated in May, 
1963, the State of Wisconsin has been served by the 
Wisconsin- English- Language-Arts Curriculum Pro- 
ject, folntly sponsored by The University of Wiscon- 
sin and the Department of Public Instruction. By 
means of two series of bulletins, Conferences, con- 
ventions, and personal school visits. more than 
5,000 elementary- school and high-school English 
teachere have been involved, many very actively. 
The pecfect ia, infact, a statewide in-service train- 
ing program In the English larguage arts. The aim 
Is to encourage teachers to think, confer, discuss, 
and write about the curriculum in English. They 
have responded magnifitantly. Over 3, 000 builetins 
go out each month; in the larger cities these are 
duplicated and distributed to additional numbera of 
teachers. By means of the reports of group leaders 
the project director is informed of the number of 
teachers who are meeling, the grade levels they 
represent, and their views on the issues that are 
raised. 


In the summer of 1964 a selected group of leach- 
ers representing all school levels met to produce a 


curriculum inthe teachirg of literature - a cumula- 
live growth pattern from the kindergarten through 
grade 12. After some months of revisions andedit- 
ing, this was published In January of 1965 as Teaching 

Literature in Wisconsin, a paper-bound volume of 

160 pages. Nearly 5,000 copies were distributed 

free in Wisconsin; it is eathmated that the total dis- 
tribution, including sales at cost, is aboul 17,000 
copies. 


By a similar process inthe summer of 10658 
new group of selected teachers prepared the male- 
rials for the volume Teaching Speaking and Writing 
in Wisconsin (1966). Over L685 Copies were dis- 
tributed free; alargenumber have been sold at cost. 


Again in the summer of 1966 lwo curriculum con- 
ferences were held, the fIrst composedoften selec- 
ted college or university teachers who used their 
linguistic knowledge and experience in the teaching 
ot English to plan the Innguage curriculum. This 
was followed by a group of teachers representing el- 
ementary, junior high school, and senior high school 
levels which was to work outa continuumof language 
learning from kindergarten through grade 12, The 
result of this ¢reatlve work and subsequent editing 
was issued in February of 1967 under thetitle Teach- 


ing the English Language in Wisconsin. Featured 
In this volume are: 


1, A linguistic approach to grammar, utillzing 
simple apeilications of structural and transfor - 
mational grammar to the language learning of 
children ard ycuth. 

2, A program that ls sequential and non -repeti- 
tive. 

3. A grammar that provides for more sophistl- 
cated sentence analysis at the lime students 
need it. 

4. Anenrichment of the language program by the 
inetusion of word-study, semantics, and the 
history of the English language. 


The three curriculum volumes listed above are 
iss.ed in experimental editions. They were thor- 
oughly revised in the light of experience Inthe ciass- 
recm and reissued in the Speing of 1968 as one vol- 


ume entitled English-Language: Arts in Wis- 


consin 
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mma Wayne Otto and Thomas (. Barrett 


THE COMMITTEE for Research in 
Basic Skills has opent a number of ycars Investi- 
Gating prodlems of teaching and learning funds men- 
tal skills tn the elementary grades. Generally, the 
Committee has chosen to be extensive in ita ap 
proach, investigating many dimensiona of aglven 
7 Oblem. Asa reeslt, there have beens series of 
atudies within broad problem areas. 


The present :nvestigation grew out of a recurring 
concern for pupils’ development of flexibility in per- 
formance In the basic skill areas. in a project en- 
titled ‘The Perception of Symbols inSktil Learn- 
ing,” Herrick, Harris, and Rarick (196))estab- 
lished the imporiance of the development of variablil- 
ity rather than r:gidity In motor-speed sets of hand- 
writing. The authors. pointed cut that their findings 
might well have Impjlealions for other areaa of 
skills development. The questionof flexibility arose 
again in two stodies (Harris and Rarick, 1087; Her- 
rick and Otto, 1661) of the handwriting act. One im- 
plication of these studies was that efflelency ina 
skill such as hancter ‘ting does mot seem te be asso: 
Ctated with the development of a fixed level of pres- 
sure bet rather with the ability to Control pressure 
within given limits. Another study by Otto (1961) In- 
Gicated that amorg good readers In the elementary 
gtadea responsivenees to auditory, visua), kines- 
thetk, and combined presentations of stimuli varies 
eccording to grade zerel and type of reinforcement. 
The varlance, however, was not shwaya Inthe dires- 
thon expected, which suggesta that one effect of the 
instractions! fFrogtam may be the develop 
men cf perceplual sets in reading. 


Tha University of Wisconsin 
Madison, Wisconsin 


mesma Theodore L. Harris 


University of Puget Sound 
Tecoma, Woshington 


These studies led the Committce to the U.S Of- 
fice of Education Project No. 1755, “The Exper |- 
mental Development of Variability In Rate of Read- 
ing in the intermediate Grades'’ (Harris, Herrick, 
Macdonald, and Rarick, 1065). The results of the 
Study showed that fourth-grade good readers who re- 
ceived s 2-week training program developed substan- 
Ulal ability lo vary their speed when reading for dil- 
ferent purposes. In the training program the chil- 
dren were given a) a brief introductiontothree types 
of reading purposea ~ reading for tha main idea, 
teading to find 8 specific fact, and reaaing to follow 
the sequence of ideaz, b) short testing and training 
passages caretclly conatructed as tounity, coher- 
enc?, emphasis, and appeoptlate content and diff t- 
culy level, ¢} separate selectiona for narrative and 
expository style, and d) testing to a criterion of full 
comprehension of each speciled purpose, = SpeeWli- 
cally, the children were shown to a) poasess ahither- 
to unreported ability to adjust signvicantly their 
steading apeeds very quickly to thelr purposes for 
teading; b) aker aigni¥icantly thelr patiern of read- 
ing speed relative to reading purposea and to maln- 
tain a significant spread in speed- purpose var iabdil- 
ity while increasing thelr reading speeds for esch 
purpose approximately 40 percent, with further 
tains upon retention tests two weeks after training; 
¢) sdjust thelr readi:.g¢ speeda to reading pur poses 
significantly different according to pasaage syle 
and to a certain extent according to sex; d) and dis- 
play the greatest improvement in reading for the 
tnain ides and specWic fact. The resailts of Project 
1285 also showed that a} chidren of comparsbdle 
Teading ablitty in the fifth and sixth grades heve 
ho more variability or spread intheit reading speeds 
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according to reading purposes thandofourthgraders; 
b) children, by their own dally ratings, greatly en- 
Joyed the 2-week training period which was largely 
self- instructional in nature;¢) during the short 
training period, children becan.e significantly more 
realistic In predicting their reading speeds when 
asked to read for sequence of ideas, but not for 
matin idea or specific fact; and d) n¢ untoward evi- 
dences of tension were found to be associated with 
reading the test passages or answering questionson 
then. 


ln keeping with its past policies, the Committee 
wanted to relate directly its research tasks to spe- 
cUle aspects of school practice or to provide the 
basis upon which Its findings could be generalized 
to school programs. The experimenters felt that 
before schcols could be expected to Implement the 
findings of Project 1755 In thelr programs, they 
should have empirical evidence that the results of 
training given under the aforesaid expeririental con- 
ditlons would indeed transfer to more typical read- 
ing tasks faced by intermediate-grade children. 
The present study is, therefore, anextension of 
Project 1755 specifically designedto investigate the 
possibilities of such transfer effects. 


The first part of the present study replicated the 
tralning and testing of Project 1755. The only major 
revision in the first part of the study was inthe sub- 
stitution of a eecond active learning group for a pas- 
sive control group. Since the preceding study gave 
evidence that trained groups achieved greater vari- 
ability than controls, It was felt tobe more perlti- 
nent to test for significant differences between types 
of training. Therefore, half of the subjects were 
trained with passages contalning anexplicitly stated 
main fdea and the other half worked with passages 
in which &@ main idea was Implicit bul not stated. 
Classroom materials may or may notcontaln ex- 
plicit main Mea statements 80 the intent was (o de- 
termlie wheter training with elther type would pro- 
duce better resuks. 


Three major hypotheses were stated: 

1, Intermediate-grade children trained with pas- 
gages containing eather explicitly stated or 
implkit maln ideas will differ in rate vari- 
adllity when reading carefully structured ex- 

sit y or nerrative materials for three dif- 
crent purposes. 

2, tntermediate-grade children trained with pas- 
sages containing either explicitly stated or 
implicit main Kieas will transfer their varla- 
tad of reading rate to mre typical mater!- 
als. 

3. Intermediace-grade children trained with pas- 
sages containing either explicitly stated or 
implicit main idexs will retain thelr variabil- 
ity of reading rate with typical materials after 
& period of one month. 


Answera to the following questions were sovght: 

1. Do children differ In their total reading rate 
when reading either narrative or expository 
material for three different purposes? 

2 Do boys and girts in grades 4,5, and 6 trained 
with yassages containing specially stated 
main ideas and chikiren trained with passages 
In which main Kdeas were Implicit, but not 


stated, differ In thelr rate vartability when 
reading either expository or narrative materi- 
als for three different purposes on a training- 
like task immediately after training? 

3. Do boys and girls in grades 4,5, and 6 tralned 
with passages Containing elther explicitly 
stated or implicit main ideas differ in their 
rate variability when readingeither expository 
or narrative materials for three different pur- 
poses on a transfer task Immediately after 
training? 

4. Do boys and girls in grades 4, 5, and 6 trained 
with passages containing elther explicitly 
stated or implicit maln ideas differ {in their 
rate variability when reading elther expository 
or narrative materials for three different pur- 
poses on a a) training-like task Immediately 
after lraining; b) transfer task immediately 
aller training; c) transfer task one month after 
training? 

5. Do children vary their ratewhen reading 
either expository or narrative materials for 
three different purposes - specific fact, se- 
quence, cr main idea ona a) training-like 
task immediately after training; b) transfer 
task immediately after training; c)} transfer 
task one month after training? 


METHOD 


SUBJECTS 


In the final analyses, seventy-two children from 
grades 4, 5, and 6 of a nilddie-class elementary 
school in Madison, Wisconsin, served as subjects. 
There were twenty-four subjects ateachgrade level, 
twelve boys and twelve girls, Inan attempt to ex- 
clude the extremes of reading ab.lity, subjects were 
chosen who '4 reading test scores that placed them 
between the fortieth and ninelleth percentiles for 
their grades, The SiEP Reading Test was used in 
grade 4, the Reading ‘‘omprehension subtest of the 
California Achevement Test was used ingrade §, 
and the lowa Reading Test was used In grade 6, 
School personnel corroborated the reading test 
scores. Table 1 shows the percentile range by 
grade and sex. 


Within sex and grade level, equal numbers of sub- 
jects were randomly assigned to the two treatment 
etoupe. To guard against attrition due to absence, 
inability to cope with the task, andexaminer ei:rors, 
extra 6ubjects, one doy and one girlfromeach grade 
level, were included in each treatment group. There- 
fore, the trealment groups comprised forty -lwo 
chikiren, of whom ait were not included In the anal- 
ysis. The evtra subjects remaining after attrition 
were randomly dropped. 


EXPERIMENTAL TREATMENTS! 


‘The distinction between groups was in 1) the na- 
ture of orlentation to reading for the main idea and 
2) the structure of riateriats cead during the orlen- 
tation and training ¢¢riods. During these periods, 
Group 1 worked with materials" inwhich a malin 
idea was explicitly stated; the task in reading for 
the main Kea was to Kentify the main idea from a 
list of sentences laken from the passages read, 
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TABLE 1 


PERCENTILE RANGE OF SUBJECTS’ READING TEST SCORES BY GRADE AND SEX 


Grade 
Fourth Fifth Sixth 
Highest Lowest Highest Lowest Highest Lowest 
Sex Percentile Percentile Percentile Percentile Percentile Percenthle 
Boys 88 48 90 62 87 40 
Girls 90 50 i.) $4 89 57 
Total i] 48 90 $4 89 40 


Group It worked with the materials from which the 
stated main idea had been deleted; the task in read- 
ing for the matn Idea involved formulating a main 
idea and then selecting the main tdea sentence from 
a list ‘dentical to the one used by Group I. Both 
groups worked with passage? of tentical length and 
essentially the same substantive subject matler. 


MATERIALS 


Materiala for orlentation to the task, for varia- 
bdility training, and for Immediate post training eval- 
uation were taken, wilh but minor adaptations ex- 
plained below, frora materials constructed for Pro- 
Ject 1758. Longer materials, more representative 
of the type encountered by elementary pupils, were 
constructed for use in the aitempts to assess the 
transfer effects of the variability training. The de- 
velopment of materials was a major focus in both 
the present project and the one thal preceded it; 
thua, the materials are described in consHerable 
detail. 


ORIENTATION MATERIALS 


The orientation materials Comprised three gets 
of passages, one set for each of the three purposes 


for teading (see descr igtion of the training program). 


Each passage was ptinted separately on charts 
which could be read (rom the location of any pup! 
in "he testing room. A list of five namea with cor- 
tespondirg telephone numbers waa used in finding a 
specific fact. Reading for sequence involved one 
basic paragtaph with three different order ings of its 
five sentences. For Group | orlentation to reading 
tor the main idea also emploged a bask paragraph 
which was rewritten three limes #0 that the topic 
sentence appeared in different per(s of the passage. 
The materials were taken from those developed for 
Project 1755. 


Because all of the Project 1755 materials in- 
cluded explicitly stated main eas, the following 
adaptations were required for use with Group EL 
First, the aentence stating the mainidea was de- 
leted from the passage esed to orient the subjects 
to reading for the main idea passage and the remain- 


ing sentences were expanded slightly to preserve a 

uniform length. Second, an additional paragraph 

was used with Group I during its orientation to the 

purpose of reading for the main idea. This pira- 
graph was similar to the first one In topic and con- 

struction, but it was used to provide further clarifi- 
cation of the task and practice in arriving independ- 
ently at a concegtion of the main dea. A pilot study 
showed that the added practice was needed. 


TRAINING MATERIALS 


The training materials developed in Project 1755 
and used in the present study consisted of three 
pacts; a set of directions, the passages to be read, 
and comprehension checks. Brief descriptions 
of each of the three parts of the training materials 
loliow. 


Directions 


The primary purpose of the directions was to 
establish a definite purpose for reading either to 
find the Main Idea, The Sequence of Events, or a 
Specific Fact. Thus, a specific question was asked 
for each selectionto be readfor aSpeciiic Fact, 
and when the purpose was to read for Sequence or 
Main Idea, the subject was told to read tolind the 
Main idea or to remember the order of events, The 
directions Were designed to make the training seli- 
instrectional, 


Passages 


The passages were written with the following re- 
sirktions and considerations in mixd. The content 
of the training materials was frora the areas of 80- 
cial studiea, science, or fiction because Shorea’ 
{1969) research indkates that teading speed fa af- 
fected by different kinda of content. 


The passages were written in narrative and ex- 
postory styles because a pilot study In Project 1755 
showed that expository materials were read faster 
than narrative, yet puplis commonly encounter both 
stylea. 


Passages were given either an inductive structure 
(i.e., the tople sentence came near the end of the 
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Relection) or a deductive structure {i.e., the topic 
sentence came near the beginning of the selection). 
The decision to consider structure of the material 
was based upon results of pilot testing in Project 
1755 which indicated that children perform better 
on paragraphs organized deductive ly than inductivcl;. 


Passages were limiled to alx to eight sentences 
with total word count ranging from 66 to 112 words 
since the earller pilot study showed that fourth- 
grade students had much difficully with longer se- 
tections before tra'ning. 


In an atlempt to keep the passages within the 
fourth-grade readability level according tothe Dale- 
Chall formula, the vocabulary was limited to grade 
4 word lists, sentence length was limited loa seven 
to fourteen words range, and typical subject-verb 
word order was maintained within the sentences. 
Each passage was allowed a maximum of two exam- 
ples of the syntactical complicatior which follows: 
relative and subordinate clauses, participial 
phrases, Infinitive phrases separated fromthe main 
verb, and inverted subject-verb word order. Five 
teachers with experience in the intermediate grades 
judged the difficulty of the materLals to be appropr!- 
ate. Asan added check, the directions for each 
passage encouraged the subjects to ask for vocabu- 
lary help as needed. : 


Each passage has a Single main idea. Group 1 
practiced with passages in which a main idea was ex- 
plicitly stated; Group II practiced with passages in 
which the same main idea was implied but not staled. 
In the passages where the main icea was not stated, 
adjectives, adverbs, and other words which dij not 
change the meaning of the paragraphs were inserted in 
the remaining sentences toyleldaconatant paragraph 
length. The nature of the daily training materials 
te ahuwn In Table 2, 


Comprehension Tests 


The position was taken that the reader should 
have access to all the passage units when selecting 
the appropriate main idea or determining the proper 
order of ideas. Thus, for the main idea and se- 
quence tasks the Comprehenaion tests contained a 
condensed or abridged restatement of eachod the six 
to eight sentences in the passage itself and the sub- 
Ject either KdentWled the main idea statement or se- 
quemially cedered the statements given. For the 
epecific fact tasks, a phrase containing a specific 
fect was taken from each semence and the swiject 
identified the correct one. 


POST- TRAINING MATERIALS 


The directiona and comprebension teats used with 
the post-training materials were of the same type aa 
the training materiais proper and the passages were 
likewise adapted from parsgtaphs constructed for 
Project 1755. Six of the passagea were written with- 
owt a atated main idea and aix were written wih an 
explick maia kiea. Each paseage was aixty-aix 
words long, including five sentencea i the main idea 
was fot stated of atx sentences if K waa stated 


TRASSFER MATERIALS 


The central question of the study la whether var- 
lability tn reading speed dereloped by training with 


TABLE 2 


NATURE OF THE DAILY TRAINING PROGRAM 
MATERIALS 


Number Selection 

4 Main Idea Selections 

,] S.quence Selection 

1 Specific Fact Selection 


carefully constructed, short model paragraphs will 
transfer to reading the longer, lesa tightly struc- 
tured passages typically found in classroom matert- 
al. Thus, the decision was tc use the types of ma- 
terlal actually employed tn classroom Instruction In 
the transfer task. With this decision, there was the 
problem of learning more about the nature and length 
of typical’? paragraphs in clementary level materi- 
als, A prelimicarv survey of tradebooks and text- 
books, especially L. -' reading series, revealed a 
lack of consistency wi. itn imermediate level mater|- 
als and even within individua! publications. 


It hid at first been assumed that construction of 
the transfer materials would Involve the use of acer- 
tain number of paragraphs, but the survey revealed 
that there was a surprising lack of correspondeme 
between parsgraphing and topical unila. Within a 
single paragraph, two or three topics might be dis- 
cussed; yet at another place in the same material 
several paragraphs might be usedtocover one topk. 
Since one of the pur poses for reading tn the study 
Involved the identification or formulation of a main 
idea, the experimentere decided tu select passages 
that contained only one main idea, regardless of the 
total number of paragraphs involved. The survey 
showed also that there was little Consistency amorg 
the materials with regard to the n nber of words 
used in the coverage of a single main Kea. Because 
the experimental design of the study called for aunl- 
form length tn the transfer test materials, the ex- 
Prrimerters arditrarily set the length at 198 words, 
three times the number of words inthe post-training 
test mater tats. 


With consideration for all the factors Involved tn 
the loseness or tightness of the structure of mato- 
rlals at the intermediate grade lerels, the expett- 
mentera decided that selections {rom the inter medi- 
ate level Reader's Digest Sxill Dullders were rea- 
sonably tepresentative of materials used by children 
tn the fourth, (ifthe, and alxth grades, 


Passages were chosen [rom the Skill Buildera In 
view of the following: each pasaage had to have a 
elngie, comptete main dea; each passage had to be 
appropriately written for one of the three purposes, 
Q.e., if the purpose were to read for sequence, the 
passage must obviously contain a Clearty recogniz- 
able sequential developmeat); and ailof the passages 
chosen had lo be generally interesting to Inter medi- 
ate-grade children bul not specUically familiar to 
them The Skill Builder selections were nmiodifled 
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only when necessary in terms of the addition or de- 
tetlon of a stated main idea, and/or the addition or 
deletion of unimportant words In order to keep the 
length constant. (The authors are indebtadto the 
editora of Reader's Digest for permissionto use 
thelr materials and for thelr examination and ap- 
proval of all adaptations made in the materials.) 
Half of the selections chosen were written In a pri- 
marily narrative style and half were expository In 

style. 


Equivalent sets of materials were necessary for 
the immediate and delayed transier testing. ''Pairs’’ 
of materials were developed by drawing iwo selec - 
tions from the same Sk'll Builder article. Since 
these articles were very short, it waa felt that vo- 
cabuLlry, style, and other factors affecting read- 
abllity were likely to be reasonably equivalent. The 
selections In each pair were assigned randomly to 
the [mm cdiate or delayed transfer testing materials, 


Table 3 is a breakdown of the tofal nuinber of se- 
lecthons used for the transfer study. 


TRALVING AND TESTING PROCEDURE 


In keeping with the framework established by Pro- 
ject 1755, the research program was divided into 
two basic paris, (raining and testing, which were 
then subdivides with time designated for each part 
as shown in Table 4. 


Training Program 


Training Examiners. A week before the training 
peogram ere the edult assistania met with the 
graduate research staff for orientation to methods 
and procedures to be used. A brief history of the 
research project was giren, and cach assistant re- 
celved a copy of the complete set of directions for 
each dey of (raining. Objectivity in working with 
the subjects was emphasized. 


Training Subjects. Days 1-3 of the training pro- 
gram served a8 an Orientation Period toprepire 
gubjecta to read for the three different pu poses and 
to familiarize them with the materials and proce: 
dures, The subjects read three practice passages 
each day. The crientation sequence is shown In 
Tadte 5. 


The difference between groupe in the Orientation 
Perjod was in presentation of reading for the main 
idea. Group I practiced with siated main ideas tn 
their parcgraphs while Group It practiced with para- 
graphs wkh Implicit main Meas. Thia distinction 
was maintained throughout the training program. 


On daya 4-10 the aubjects praciked for 30-45 
minete perloda each day, during which they read 
six selections daily. The selections were randomly 
ordered for the total group of eighty-four subjects 
every Gay. 


tn addition to reading passages, subjects also 
practiced predicting their reacing speed for each 
aelection, Thia was followed by recording aclual 
speed on thelr indivkvual graphs and on Time Record 
Sheets, RB was felt that thia would helpeach sodject 
evaluate hia owe progress; the graph would erste 
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TABLE 3 


NATURE OF THE SELECTIONS USED IN THE 
IMMEDIATE AND DELAYED TRANSFER SESSIONC 
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Selections for 
Immediate Transfer 


Selections for 
Delayed Transfer 


Stated Malin Idea 


2® Main Hea 2 = Main Idea 
2 Sequence 2 Sequence 
2 Specific Fact 2 Specific Fact 
Unstated Main Mea 
Main Idea 2 Main Idea 
2 Sequence 2 Sequence 
2 Speclfic Fact 2 Speclfle Fact 


*There was one narrative and one expository 
selection in each patr. 


him {o visualize the differences in reading rate for 
exch of the three purposes {cr reading. 


On each of the seven praclice days, this proce- 

dure was followed: 

1. Each subject received his set of self-instruc- 
tiona) materials and read the directions to 
establish a purpose for reading. 

2. Each subject predicted his reading speed on 
his grapd. 

3. Each subject timed his reading of the selection 
with a stop watch and recorded actual reading 
time on Titae Record Sheets. 

4. An answer sheet accompanying the sélection 
was ther. completed. 

&. Subjects were expected to read to full compre- 
henston or 100 percent accuracy in responding 
to ihe comprehension test items. Due to the 
nature of the tesis, five trials was the max i- 
mum. The assistants checked tadividual re - 
sponges after each trial. 

6. Raw time scores were translated into words 
per mirate scores by the avdjects, who were 
supplied with conreraion tables. 

1, Subjects then plotted reading speed on their 
graphs to show & comparison of peedicted and 
sciual reading speed. The graphing waa in- 
tended to serre as a mitivational devke. 


ADMIN STRATION OF TRE TRAINING PROGRAM 


T> obtain manageable groupefor the training zes- 
sions, Groups | and fl were each divided into two 
training groups of twenty-one subjects, Three 
groups met separately In the lesting room during 
the morning, and one group met in the aflerncon. 


Fouts research assistants conducted the Training 
Program. Sue each had Leen inrolred in working 
on vatious phases cf the training materials and train- 
ing procedure, It was felt that they would be highly 
consistent in thelr administration of the four train 
ing growpe. Four of (ive adult asatatants were 
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TABLE 4 
SEQUENCE OF RAINING AND TESTING 


rn a eee EEE 


Tralning Program 


Testing Program 


Orientation Training Post: Training Immediate Transfer Delayed Transfer 

Period Period Test Period Test Period Tect Period 

Days 1-3 Days 4-10 Day ll Days 12-13 Days 14-15 
(one month 
follow ing 
Days 12-13 

TABLE 8 

ORIENTATION SEQUENCE 

o_o —>—=—=&[{TVVD@a=qIq_™_— ee ——=— 

Nay Day 2 Day 3 


sn 


Irtroduction to 
()) three purposes for reading 
(2) use of stop watches 
(3) use of Time Record Shrets 


available at each session to supervise the subjects’ 
work. The resulting ratio of one adult for every 

four or five subjects Insured adequate supervision 
of the work and Immediate feedback on the compre- 
hension tests, 


The following administrative details were pat- 
terned efter Project 1755: 
1. Training groups were no larger than twenty- 
one sudjects. 
. A large, well-ventilated, well- lighted, quiet 
TOOM Was USCC. 
. Individual work space was available for each 
pupil. 
. All necessary supplies were provided by the 
researchera. 
. One atult was assigned to work with every 
four or five subjects. 
Instructors ard assistants were trained in the 
testing procedures and to anticipate possile 
problema. 
7. Detailed printed instructions were provided 
for Instractors and assistants. 


TESTING PROGRAM 


The procedure followed during the three phases 
of the Testing Program {see Table 4) deviated froin 
the Training Program in these ways: (1} For the 
Post-Tralning Teat, day 11, 12 randomly ordered, 
stxty- six word selections were read instead of the 
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sftroduction fo 
(1) Conversion tables 


(2) Graphs 


— ee — 


Introduction te 
(1) predisting reading speed 


usual six selections of varying length. Four ran- 
domly ordered selections were read for each of the 
three purposes. ‘rhe total reading time in seconds 


for each purpose was recorded. The pupils di!) rot 
use their graphs. (2) The Srimediate and Delayed 
Transfer selections were 168 words in length. They 
are described in detail in th2 materials section of 
(his paper. All subjects 1€24 twelve randorly or- 
dered gelections, six with and six without a.t xpli- 
Citly stated main tdea, for tmmediate Transfer on 
days 12nd 19. One month later, on days 14 and 
ik, they read twelve selections Comprising the sec- 
ond half of the set of transfer materisis. During 
the two transfer testing periods, the assistants re- 
corded the subjecta’ t-€al reading Lime In seconds 
when reading for each purpose. No graphs or ¢on- 
version tables were used. 


The assumpticn was that In order to assess the 
eifects of the stated and Implied main idea treatment 
conditions It was necessary to test the subjects on 
materials with snd without explicitly stated main 
ideas. A reasonable expectation would be that sub- 
fecls trained with stated main Meas would do best 
on test materials which contained stated main eas 
and tose trained with materials having implicit 
main ideas Would do best on test materials with im- 
plicit mats. ideas. To asseas the overall effect of 
the lreatmert conditions, the experimenters were 
concermed with the best performance on both typea 
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of materials. Inordertogetascore wiich indicated 
this total performance, regardless of type of mate- 
rial, the mean score of the subjects’ performance 
on narratlve and expository materialwas found, 
thus reducing the number of scores for each subject 
to six. 


DESIGN AND ANALYSIS 


In order to determine the varlabillty of reading 
rate for the three different purposes - specific fact, 
sequence, and main idea - a variability score was 
catculated for each suject. The style of the mate- 
rial was considered in tnat two rate variabllity 
scores were calculated for each subject - one for 
narrative and one for expusitory materials. The 
varlability scores were calculated according to the 
standard varlance formula: 


ou8 i-Xy 
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Xi was the sum of individual scores where | varied 
across the three purposes; X was the mean of the 
three purpose scores, andn=3, Thus, the vari- 
ance scores towk into account the subjects’ reading 
rate for one purpose In relationto all purposes 
(mean rate). There were three different designs 
and consequently three different types of analysis, 


One was a subject X purpose one way analysis of 
variance design. The dependent variable for the 
analysis was the proportion of each individual’s 
reading rate for each single purpose to his total 
reading rate for all three purposes. 


Due to the fact that each subject read for three 
purposes, a repeated measures sltuation existed. 
Greenhouse and Geisser (1959) have pointed out that 
for the usually computed F ratloa of mean squares 
in the regular analysis of variance tobe exactly dis- 
tributed as the F distribution, it is necessary that 
the columns or tests in additlon to belng normally 
distributed, having equal varlances, should be mu- 
tually Independent. Since the measures were made 
on the same subjects, the independence assumption 
could not be met. 


Although one approach to thls problem would be 
to use a multivariate analysis of variance design,a 
simpler approach 1s to follow the procedure of ad- 
justing the degrees of freedom which results in con- 
servative F ratios which approximate the F dlstri- 
bution when the independence essumption isnot met 
(Greenhouse and Gelaser, 1959). The adjusted de- 
grees of freedom are in this case land 71 respec- 
tively. Six analyses were also done using this de- 
elgn and procedure. 


The second was a3 X2X2 completely crossed 
analysis of variance desien with three grades, two 
sexes, pn two training methods and with six repli- 
cates per czll. The model was assumed tobe fixed. 
The reading variability scores were transformed ly 
using the natural log to base e. This, the scores 
() used in the analysis were: 


3 7 a2 
prmiieg ss Ll. 
{=1 n-1 


After the scores were transformed, an analysis of 
varlanve was done on the means of the variances ac- 
cording to the procedure outlined by Scheffé (1960) 
for the comparison of varlances. 61x analyses were 
done according to these design and analysis pro- 
cedures. 


The third design was a 3X2X2%X3 analysis of 
varlance wlth three grades, two sexes, two trainIng 
procedures, andthree repeated measurements or 
tests - a training test Immedlately after training,a 
transfer task immedlately after training, and a de- 
layed transfer task one month after training. The 
dependent variable for the analysesusing thls design 
was rate varlabillty. ‘I'wo analyses were done using 
thls procedure, Conservatlve F tests using the 
Grecnhouse and Geisser (1959) procedure were also 
used in this analysis. The adjusted degrees of free- 
dom were 1 and 69 respectively. For all F ratlos 
found to be significant post hoc comparisons among 
the means were done following the procedures of 
Scheffé (1953). 


RESULTS AND DISCUSSION 


The subjects consistently varled their rate when 
reading elther narratlve or expository mater lal for 
three different purposes. The analyses summarized 
in Table 6 also show that there was a difference in 
rate variability on the immediate post training test, 
the transfer task, and the transfer retentlon task. 


Mean proportions of reading time are shown in 
Table 7, The trend there is clear and, with but one 
exceAlon, consistent: the childrenread most rapid- 
ly to find specific facta; they read less rapldly for 
main ideas, and they read most slowly for sequence. 
The Scheffé post hoc test for multiple comparisons 
reveals significant differences between all means 
except the Fost-Narrative, Main Idea, and Specific 
Fact. This is in line with the logical expectation 
that, with training, children would be able to adapt 
their rate of reading according to purpose; that they 
would be best able to pick out specific facts very 
quickly; and that the task of reading toarrange facts 
in sequence would be most time consuming because 
the subjects would need to deal simultaneously with 
several facts. 


Materials were written {n narrative and expos!- 
tory styles because there was evidence that style 
affects rate. When the means in Table 7 were col- 
lapsed across style, there was virtually no differ- 
ence between the narrative and expository means 
(Expository = .340; Narrative = .333). Yet, a com- 
parison that takes purpose into account, as shown 
in Table 8, reveals that style interacts with purpose; 
expository materials are read most rapidly for the 
main idea, but narrative materials are read most 
rapidly for sequence and for specific fact. By way 
of post hoc interpretation, it would appear that the 
expository arrangement makes for more clearly 
identifiable main ideas. Likewise, the narrative ar- 
rangement of materia!s would tend to havea sequen- 
tial arrangement built {n and, therefore, be more 
easlly identifiable. An explanationof the more rapid 
reading of narratlve materials for specific fact Is 
more elusive; but it might be argued that a narra- 
tive- sequential arrangement lends clues that make 
for rapid location of facts. 
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TABLE 6 


ONE WAY ANALYSES OF VARIANCES FOR TOTAL READING RATE FOR THREE DIFFERENT PURPOSES 
WITH EXPOSITORY AND NARRATIVE MATERIALS ON POST, IMMEDIATE, AND DELAYED TESTS 


Description af MS F 
Purposes on Expositovy Posttest 2( 1) . 40 40* 
Error 213 (71) 01 

Purposes on Narrative Posttest 2( 1) 712 : 12* 
Error 213 (71) .01 

Purposes on Expository Transfer Test 2 (3) 97 9o7* 
Error 213 (71) .O1 

Purposes on Narrative Transfer Test 2( 1) . 92 92* 
Error 213 (71) 01 

Pur poses on Expository Retention Test 2( 1) 84 84* 
Error 213 (71) .01 

Purposes on Narrative Retention Test 2(1) , 36 3B* 
Error 213 (71) 01 

*p<.0l 

TABLE 7 


MEAN PROPORTION OF READING TIME FOR TOTAL COMPREHENSION BY STYLE OF MATERIAL, 
TIME OF TEST AND PURPOSE 


——— eee 


Pur pose 
Test and Style Main Idea Sequence Fact 
Post-Expository 331 . 409 . 261 
Post-Narrative . 889 . 393 - 218 
Immediate Transfer- Expository . 359 . 435 .207 
Immediate Transfer-Narrative . 348 - 438 .214 
Delayed Transfer-Expository 325 . 446 229 
Delayed Transfer-Narrative . 382 . 366 . 252 
TABLE 8 
MEAN PROPORTION OF READING TIME By STYLE AND PURPOSE 

Pur pose 
Style of Material Main Idea Sequence Fact 
Expository 338 . 430 - 252 


Narrative 373 . 399 . 228 
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TABLE 9 


ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMFNT FOR EXPOSITORY MATERIALS AND 
POST PERIOD READING VARIABILITY FOR THREE PURPOSES 


Sex 
Trvatment 
Gxs 
GxT 
SXT 
GXxXSXT 
Error 


Ome Nw = 


a 


TABLE 1.0 


MS F 
5. 98 2, 89 
1,00 <1 
- 55 <1 
2, 98 1, 46 
4,30 2.10 
1.14 <1 

84 <1 
2.05 


ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR NARRATIVE MATERIALS AND POST 
PERIOD READING VARIABILITY FOR THREE PURPOSES 


Source of Variation df 
Grade 2 
Sex 1 
Treatment 1 
GXxs 2 
GXT 2 
SXT 1 
GxS8xXT 2 
Error 60 


MS F 
3. 76 1, 62 
2. OF <1 
4.11 1, 66 

. 64 <1 

23 <1 
1,17 <1 
1, 24 <1 
2, 48 


The type of materlals used during the training 
sessions did not make a difference inthe children’s 
subsequent variability rate when reading for three 
different purposes (see Tables 9-14). Chiidren 
trained with passages containing explicitly stated 
main ideas did not differ in rate variability from 
children trained with raaterials with implicit but not 
specifically stated main ideas. The types of train- 
ing materials are subsequently referred toas stated 
and unstated, respectively. The implication is that 
materials varied on this aspect do not affect chil- 
dren's ability to vary their reading rate. Thus, 
elther type of training materlals should produce sim- 
ilar results if reading variability across purposes 
is the objective of the training. 


The use of different types of training materials 
did not have any eifect on the transfer task. When 
children were given an extended passage which was 
more closely related to the actual school reading 
task, children trained with stated materials did not 
differ in their rate variability from children 
trained with unstated materials. 


The same 128 true for the transfer retention 
task. When culldren were tested for retention on 
the transfer task, no differences 'n rate variability 
were found between the two groups trained with dif- 
ferent materials. 


However, one might speculate that if the approach 
to instruction had been varied for each type of ma- 
terlals, the results might have been different. For 
example, if the children who worked with unstated 
materlals had been trained explicitiy in devising 
their own main idea statements, they might have 
done better than the other group when all subjects 
were tested on both stated and unstated matertlals, 
Such speculation seems to suggest a possible next 
step for research that focuses upon training pro- 
grams for the development of rate var ability. 


Whether the children were reading expository or 
narrative materials, the results were the same, 
Consistently on the post, immediate transfer, andde- 
layed tranefer tests no differences were found between 
the group trained with stated main Idea materials and 
the grouptrained with unstated main idea materials, 
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TABLE 11 


ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR EXPOSITORY [MATERIALS AND 
IMMEDIATE PERIOD READING VARIABILITY FOR THREE PURPOSES 


Source of Variation at 


Grade 

Sex 
Treatment 
GXxs 
GKT 

S «KT 
GXSXT 
Error 


on rN NOH 1 


a 


TABLE 12 


MS F 
4.94 2,66 
4, 22 2.27 

34 <1 
2,35 1, 26 
2,40 1,29 
4, 43 2. 38 
2, 40 1, 29 
1, 86 


ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR NARRATIVE MATERIALS AND 
IMMEDIATE PERIOD READING VARIABILITY FOR THREE PURPOSES 


& 


Source of Variation 


Grade 

Sex 
Treatment 
Gxs 
GXxT 
SXxT 
GXSXT 
Error 


ONY MND 1 


a 


Sex did not make a difference inthe rate var- 
lability of children trained with either of the two 
types of materials. This result was consistent. 
Boys did not differ from girls in their ability to vary 
their rate from purpose to purpose immediately 
after training, on the transfer task or on the trans- 
fer retention task. 


The same results held across grade level. There 
was no difference among fourth, fifth, and sixth 
graders in reading rate variability from purpose to 
purpose on ec th separate testing occasion. How- 
ever, the trends indicated by the means (Table 15) 
are consistent. Fourth graders consistently showed 
more variabillty of reading ratethan dd fifth 
graders, and fifth graders consistently showed more 
var lability of reading rate thandidthe sixth graders. 
This could be due to the younger children’s more 
flexible mental eet, which could muke them much 
more susceptible to training. 


The absence of grade by treatment interaction in- 
dicates that the two different training procedures 


MS F 
271 <1 
5. 33 1. 60 
- 00 <1 
1,51 <1 
5. 10 1.53 
32 <1 
03 <1 

3. 33 


did not have different effects across grade level. 

This might not have been so if matertals had been 

prepered for each specific grade level. Further in- 
vestigation taat focuses upon possible developmental 
trends might be worthwhile. 


The total reading variability across occastons 
(tests) on expository materials was found to differ 
by grade (Table 16). No grade differences were ap- 
parent, however, on the total reading var lability 
across occasions on narrative materials (Table 17). 
Mean rate variability by grade and ty pe of material 
is shown in Table 18. Scheff€ post hoc tests for 
multiple comparisons revealed that the only signifi- 
cant difference is between the mean scores of fourth 
and sixth graders when reading expository material. 
This supports the trend found with individual tests. 
By way of Interpretation, the suggestion is that older 
pupils may have a fixed set for approaching the read- 
ing task; whereas, younger pupils may be more 
readily susceptible to rate variability training. If 
this is so, the Implication is that suchtralning ought 
to be given early in the intermediate grades, 
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TABLE 13 


ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR EXFOSITORY MATERIALS AND 
DELAYED PERIOD READING VARIABILITY FOR THREE PURPOSES 


Source of Variation df MS F 
Grade 2 2. 97 1,40 
Sex i . 16 <1 
Treatment 1 27 <1 
Gxs 2 . 23 <1 
GxT 2 .31 <1 
S XT 1 71 <1 
GXSXxT 2 1, 93 <1 
Error 60 2.12 

TABLE 14 


ANALYSIS OF VARIANCE OF GRADE, SEX, AND TREATMENT FOR NARRATIVE MATERIALS AND 
DELAYED PERIOD READING VARIABILITY FOR THREE PURPOSES 


Source of Variation af MS F 
Grade 2 5. 80 2,10 
Sex 1 1. 78 <1 
Treatment 1 15 <1 
Gxs 2 2. 95 1,07 
GXT 2 2. 45 <i 
SXT 1 1, 36 2,67 
GXSXxT 2 2. 44 <1 
Error 60 2. 76 

TABLE 15 


MEANS FOR EACH GRADE ON EXPOSITORY AND NARRATIVE MATERIALS ON THREE DIFFERENT 
TEST OCCASIONS 


Type Occasion Grade Grade Grade 
4 5 6 
Post 3.07 2,66 2, 98 
Expository Immediate 6. 29 6. 20 5,46 
Delayed 6. 40 5. 89 5.72 
Post 3. 45 3.35 2,72 
Narrative Immediate 5. 66 5. 92 5,59 
Delayed 5. 80 6.61 4, 8% 
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TABLE 16 


ANALYSIS OF VARIANCE OF GRADE, SEX, TRAINING AND TEST OCCASION FOR READING VARIABILITY 
WITH THREE PURPOSES AND EXPOSITORY MATERIALS 


Sources of Variation df MS F 
Training 1 - 10 . 05 
Sex 1 2. 83 1, 35 
Grade 2 (1) 13. 57 6, 49% 
Occasions 2 (1) 36. 23 17, 32% 
TxXS8 1 . 8B 42 
TXG 2 3.04 1,45 
TXxXO 2 37 18 
8 XG 2 2.26 1,08 
8 xo 2 1,57 275 
Gxo 4 74 185 
TXS XG 2 2.51 1, 20 
TXS xO 2 3.02 1,44 
TXGXxXO 4 1, 62 . 78 
8 xGxO 4 1.49 oth 
TXS XxGxO 4 1,53 £13 
Within (error) 180 (69) 2.09 

*p<.05 

TABLE 17 


ANALYSIS OF VARIANCE OF GRADE, SEX, TRAINING AND CEST OCCASION FOR READING VARIABILITY 


WITH THREE PURPOSES AND NARRATIVE MATERIALS 


Sources of Variation df MS F 
eee 
Training 1 86 30 
Sex 1 8. 61 3, 01 
Grade 2 7, 87 2, 18 
Occasions 2 2.55 89 
TXs 1 1. 61 56 
TXG 2 1, 28 44 
TXO 2 1, 70 60 
§ XG 2 1, 24 43 
8 xo 2 28 10 
Gxo 4 . 20 42 
TXS§ XG 2 2. 34 82 
TxXs xo 2 3, 62 1,26 
TXGXxO 4 3, 25 1.13 
8 XGxO 4 1, 93 67 
TXS XGXO 4 . 69 24 
Within (error) 180 2. 86 
eee 


The analyses summarized in Tables 16 and 17 
also reveal a difference in rate yarlability across 
tests - post-tralning, Immediate transfer, and de- 
layed transfer - with expository materlals but not 
with narrative material. Mean rate variability by 
test and type of material is shown in Table 19. 
Scheffé post hot tests show a significant difference 


between the post-training and the immediate and de- 
layed transfer tests with expository material. The 
suggestion is that not only does the ability to adjust 
rate to purpose transfer from training passages to 
more naturalistic materials, but alsothere is an 
increase in rate variability. The increase might 
be expected on the basis that the materials in the 
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TABLE 18 


MEAN RATE VARIABILITY ON ALL TESTS BY 
GRADE LEVEL AND TYPE OF MATERIAL 


Grade 
Type 4 5 6 
Expository 5. 98 5. 65 5. 12 
Narratlve §. 79 5. 93 5.12 


transfer test s"tuations were more nearly like class- 
room materlals and tess rigidly structured; there- 
fore, the subjects were better able to use their rate 
variability skill. 


tt must be noted that the main effects of grade 
and test were significant only with expository mate- 
rials, Yet, the trends were generally simUar. The 
structure of the expository material apparently was 
more conducive to rate variability than that of nar- 
rative material. Whether this is generally so, of 
course, remains to be seen. 


There was no difference In the total reading var- 
lability of boys and girls. Boys and girlsthus learn 
the same amount durlng the training situations, No 
differences were found un any of the interaction fac- 
tors, which indicates that ail factors were consist- 
ent in combination, 


The type of training materials used did not result 
in a difference on the total reading variabllity 
across occasions regardless of whether the children 
were reading expository or narrative material. This 
again emphasizes the similar effect of either of the 
two types of training materials. It may also indicate 
that in the future this type of research ought to be 
concerned with combinations of materials and in- 
structional procedure in order to maximize the ef- 
fect of training. 


TABLE 1¢ 


MEAN RATE VARIABILITY FOR EACH TEST BY 
TYPE OF MATERIAL 


Test 
Type Post Immediate Delayed 
Expository 4.77 5. 99 6.01 
Narrative 5. 37 5. 73 5. 43 


FOOTHOTES 


1, The research reported herein was supperted by 
the Cooperative Research Program of the 
Office of Education, U. S. Department of 
Health, Education and Welfare. This paper 
first appeared in manuscript form entitled 
“Transfer Effects of Training Intermediate 
Grade Pupils to Adjust Reading Speed to Read- 
ing Purpose, ’’ Cooperative Research Project 
No. 3137, Committee for Research in Basic 
Skilis, The University of Wisconsin, 1966. 


2. An appendix containing the directions and mate- 
rials used can be obtained fromthe authors 
on request. 
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mms Strategies for Concept 


Attainment in Mathematics 


IT WOULD bea mistake for the writer, 
being trained in mathematics rather than psychology, 
to do basic research In conceptual learning. On the 
other hand, It is quite appropriate for him to ac- 
quaint himself withthe results of experimentation by 
psychologists and to manlpulate these results in dif- 
férent ways to see how they apply in mathematics 
instruction. In the latter sense, or: might say the 
paper has an operational flavor. Tuat is, it dis- 
cusses ways Classroom teachers might attack in- 
struction in a specific concept vi santhematics and 
means writers of classroom materials ml ght use 
to insure that provision had been made for learning 
experiences that would leadtoat-ainment of a specif- 
ic conceyt, 


A teacher who faces a mathematics c lass five 
days each week often finds psychological research 
of very little help in solving his instructional prob- 
lems. The research, for obvious reasons, must 
start with those situations that present knowledge 
canhandle. Arcsearch psychologist legltimately 
pursues his interest in pure psychology; he may 
have fleeting thoughts about applications of his re- 
search, but the excitement of carrying on investiga- 
tions in his particular field of Interest leads him to 
put these thoughts aside - temporarily, perhaps. 


Today, however, there exists sufficient evidence 
On human learning aswell as numbers of well-trained 
mathematice teachers s0 that applications can be 
made in classrooms. It ig possible today to have 
classroom experimentation that makes use of, or 
manipulates, basic psychological research in human 
learning. Emerglng among mathematical educators 


wamest Myron F. Rosskopf 


Teachers College, Columbia University 
New York, New York 


and psychologists are plans for studies that wilt ap- 
ply in a subject matter field the results obtained 
from the Intensive study of conceptual learning of 
recent years (that Is, since World War II). Every 
discipline has Its own subtletles. For this reason, 
success of such experimentation willdepend upon 
facility of communicatlon between psychologlsts and 
representatives of other disciplines. 


DEFINITIONS 


CONCEPT 


The word ‘‘concept”’ seems to have as many def- 
{nitions as there are writers on conceptual learning. 
Recently, a definition appeared that has the virtue 
of efforts made to relate it to existing definitions. 
According to this recent statement, 

Anything that is a concept has the following 
attributes: 
1. Psychological meantngfulness 
If. Intrinsic, functional, or formal properties 
TL. Abstractness 
Iv. Inclusiveness 
Vv. Generality 
VI. Structure 
VIE. Functlon (Klausmeier, Davis, Ramsay. 
Fredrick, and Davies, 1965, p. 3}. 
A possible criticism is that the deflnitlon introduces 
words which in turn need to be defined. True, but 
it turns out to be easier to define (or descrlbe) these 
new words than it was to define ‘‘concegt, ’’ 


Two aspects of the definition that make it useful 
are its open-endedness - by means of item V, 
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Generallty - and its own inclusiveness. Simplecon- 
cepts as well as very complex conceptsare possible 
of characterization by means of the definition. 


The writer has been using tha following definition 
of a concept, probably because it lent itself so weil 
to explanations of mathematical concepts. Acon- 
cept is ‘‘a way of grouplng an array of objects or 
events in terms of those characteristics that distin- 
guish this array from other objects or events Ln the 
universe’ (Bruner, Goodnow, and Austin, 1956, p. 
275). This suffices for a first level concept, but to 
obtain the complexity that we know, at least intui- 
tively, some concepts have, we need to add to the 
definition cited; and including ‘‘the network of infer- 
ences that are or may be set into play by an act of 
categorization’ (Bruner, et al, 1956, p. 244). 


We shall not stop to relate these two definitions. 
Interested readers can go to the references cited 
and see that the two do indeed contain the same ele- 
ments. Instead we shalt consider an example of a 
concept in mathematics and show in what way it sat- 
Isfles the conditions of the first definition stated. 
Consider, for example, the set of all counting num- 
bers, or as they are ofter, called the set of ali nat- 
ural numbers, 

(1, 2, 3, coe, DD 1, iad 
One can discriminate certain subsets of this set. 
There is the set of all even natural numbers, 


[2, 4, 6, ..., an, ...]; 
and the set of all odd natural numbers, 
{1, 3, 5,..., 2ne+1,...]. 


For our example of a mathematical concept, how- 
ever, we shall consider that of the set of all prime 
(natural) numbers, 

{2, 3, 5, 7, 11, 13,...). 


When a person can distinguish between prime 
numbers and numbers that are not prime (that is, 
that ar? composite), then he lias a concept of prime 
numbers, He can demonstrate his possessionof the 
concept by filiing in the next few prime numbers, or 
by devising a test for deciding whether a number 
presented to him is prime, or not prime. He has 
grouped the array of objects, the set of natural num- 
bers, so that he can tell the difference between a 
prime number and a composite number. He has 
used the characterlstics that distinguish between 
prime numbers and other membersof the set of nat- 
ural numbers. Really, the person has formed two 
categories of natural numbers; those that are prime 
form one category; and those that are composite 
form the other category. 


At this stage of his concept of a prime number, 

a person recognizes the formal properties. He cer- 
tainly is working at an abstract level, since he is 
working with numbers, and at a level of generality, 
since many subsidiary concepts such as factoriza- 
tion, multiplication, and so on are involved. From 
the point of view of structure, the person probably 
has used a Conjunction of related concepte to arrive 
at a concept of prime numbers. 


But we recognize more {naconcept than just the 
forming of categories according to some discriml\- 
nating characteristic or characteristics. Part of 
the concept of prime numbers is realization that 
their number is infinite, that there is just one even 


prime, that no one has devised a formula for prime 
numbers, and that there are many such open ques- 
tions related to this interesting subset of the set of 
natural numbers. In other words, we are willing to 
accept as part of the concept these inferencesdrawn 
irom the categorization. 


It seems that such associations with the set of 
prime numbers would qualify it for the attribute of 

chological meaningfulness. There remain the at- 
tributes of inclusiveness and function. Now, inelu- 
siveness is so much a part of specifying a set in 
mathematics that as soon as one Is able (that Is, 
correctly in the sense of mathematical criteria) to 
talk about the se: of prime numbers, the attribute 
of inclusiveness foliows. Prime numbers as medi- 
ators occur in prime factorization, calculation of a 
least common multiple, and the prime factorization 
theorem of arithmetic. Hence, tlhe concept has the 
functlon attribute also. 


All right. It is possible to relate what mathema- 
tlclans cali a concept to what psychologistscall a 
concept. But a definition, if it really is adefinition 
must partition the universe of discourse into those 
things that are concepts and those things that are 
not concepts. A ‘‘definition’’ that is all inclusive 
might just as well not be stated at all. In short, it 
must be possible to point to something In mathemat- 
ics that is not a concept. But that is easy; any addi- 
tion fact, such as 5 + 4 = 9, is not a concept. 


CATEGORIZING OR CONCEPTUALIZING 


The word '‘category’’ was used in the preceding 
discussion. What Is Involved in categorizing? How 
is it related to conceptualizing? More important, 
how {s categorization related to the use of concep- 
tualization in applications, or problem solving, in 
mathematics? First, let us analyze another exam- 
ple of a mathematical concept and, second, derive 
from the discussion of the example what seem to be 
characteristics of categorizing. 


Consider the concept of a rational number. Its 
formation starts very early inthe home experiences 
of a preschool child. One-haif and one-fourth are 
known for names of parts of things; one-half of an 
apple or an orange or a glass of juice or a candy bar. 
During early schooling, the concept is expanded to 
include written symbols for one-half and one-fourth: 
1/2 and 1/4; 1/3 also is added to the list. However, 
the concept is still on the level of these symbols be- 
ing names for parts of things. There seems little 
evidence that a child thinks of 1/2, 1/4, 1/3 as ex- 
emplars of a new sox't of number. The teacher may 
cal] these fractions rames for numbers, of course, 
but still the concept, the way of categorizing these 
numbers, of telling how they differ from other num- 
bers, is in terms of a way of expressing them; to 
wit, a numerator, a horizontal bar, and a denomi- 
nator. 


Not until quite late does the instruction reach the 
stage of giving a new name, rational numbers, to the 
set of numbers that can be expressed as the quotient 
of two integers, the denominator not zero. Now the 
concept has formal properties; it has been formal- 
ized, one might say, and it will be even more for- 
mal (that is, abstract) when a student recognizes 
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ratlonal numbers as ordered pairs of Integers In 
which the second member is not zero. 


At each level of formality, there are cues that a 
student looks for: 1) one of two congruent parts of 
something, such as an apple; 2) a numerator,a hor- 
izontal bar, and a denominator; 3) a quotlent of two 
integers; and 4) an ordered pair of integers. These 
cues help a student put a number he encounters into 
ite proper category, to align it with the concept he 
has formed of the set to which that number belongs. 
Notice, too, that the invention of ways of grouping 
predictive characteristics is involved; for example, 
the numerator, horizontal bar, and denominator. 
The test of the invention is its usefulness. Does it 
effectively categorize numbers? 


CategorIzing has for its basis defining character- 
istlcs. By grouping together things that satlsfy the 
defining characteristics of a class, an individual a) 
reduces the complexity of his environment; b) iden- 
tifies the objects ina particular universe of dls- 
course; c) reduces the necessity for constant learn- 
ing; d) glves direction to actlvity; e) orders and re- 
lates classes (Bruner, etal., 1956, pp, 12-13). 


What are the implications for problem solving in 
mathematics? If a student does not classify prob- 
lems he meets, then he must treat each problem as 
an indlvidual. The cognitlve strain in such a proce- 
dure is enormous. The student must, perforce, for 
pur poses of economy of effort look for distIngulsh- 
ing characteristics or discriminable attributesof 
problems in order to reduce the strain. That is, he 
must use Cues, put the problem in a pre-decided- 
upon category, and bring into play concepts that in 
the past have becn effective in solving problems of 
this particular category. It would seem that a cate- 
gorization of a problem is the first step toward its 
solution. Only after a problem has been pina 
certain category can one proceed with plans for 
solving it. 


Of course the first plan chosen mayfail. If it 
does, a person has to devise variations on the first 
plan. Perhaps he failed to discriminate carefully 
enough when he categorized the problem. In other 
words, taking a first step toward its solution, leads 
him to recategorize the problem. The iraportant thing 
is thathe must realize that the initially chosen method 
of solution fails and then search for anew method. 
He must shift his plans, and this requires strategy. 


STRATEGIES IN 
CONCEPTUALIZATION 


STRATEGY 


A strategy is a carefully planned calculation and 
coordination of the specific ends and means neces- 
sary to achleve a goal. That is, as in the following: 

A strategy refers to a pattern of decisions 
in the acquisition retention, and utillzation of 
information that serves to meet certain objec- 
tives, e,, to insure certain forms of outcome 
and to insure against certain others. Among 
the objectives of a strategy are the following: 
a. To insure that the concept will be at- 
tained after the minimum number of 
encounters with relevant instances. 


b. To insure that a concept will be attained 
with certainty, regardiess of the number 
of instances one must test en route to at- 
tainment. 

c, To minlmlze the amount of strain on in- 
ference and memory capaclty while at 
the same tlme insuring that a concept 
will be attained, 

d. To minimize the numbér of wrong cate- 
gorizations prior to attaining a conceyt. 
(Bruner et al., 1956, p. 54.) 


The preceding definition of a strategy and a de- 
scription of the aims of a strategy is very similar 
to the mathematical definition of a strategy that Is 
associated with the theory of games. However, the 
theory of games strategy consists of a set of deci- 
sions made in advance. Once the decisions are 
made, no change can be made while ‘‘play’’ is going 
on. Incontrast, a problem-solving strategy, for ex- 
ample, may be changed In the midst of a subject's 
efforts; such changes are dictated, or shouldbe dic- 
tated, as the subject’s knowledge of the problem 
grows through his efforts tof{Ind a method of solution. 


TYPES OF STRATEGIES 


‘Virtually all the effective strategies for attain- 
ing concepts « »pend upon the use of sone sort of in- 
itial focus,’’ (i3runer, et al., 1956, p. 63). How 
does the subject perceive the situation? What as- 
pects of it holds his attention? How does he define 
the task to himself? If the task Is a problem situa- 
tion, what data seem to be most relevant? How 
does he fit this problem into his concept pattern of 
all types of problems with which he has had experi- 
ence? After making an Inltial focus with respect to 
the problem, a subject still faces the necessity for 
decis!ons concerning a method of attack. What sort 
of strategy should he decide upon? According to 
Bruner and his associates there are four ideal ctrat- 
egies: a) simultaneous scanning; b) successive scan- 
ning; c) conservative focusing; and d)} focus gambling 
(Bruner, et al., 1956, pp. 83-90), 


a) Simultaneous scanning. The simultaneous 
scanner forms many possible hypotheses to follow 
toa solution and keeps all of these hypotheses in 
mind. The strainon memory Is great. Inltlally, he 
chooses one of these hypotheses and tests it to see 
if {t is promising and at the same time to see which 
of the other hypotheses it ellminates. A subject us- 
ing this strategy has to keep allof the hypotheses in 
mind; he has to deduce which are eliminated, andas 
he proceeds to test a remaining hypothesis, he must 
remember which hypotheses were eliminated by his 
ear ller testing. 


The critical point In simultaneous scanning de- 
pends uvon a subject’s abillty to deduce all the in- 
formation with respect to which hypotheses should 
be discarded from the testing of an inltial hy pothe- 
sis. If he can do this, then he can proceed with 
maximum Infor mation to test a remaining hy pothe- 
sis. However, memory strain and the factor of 
time usually prevent him from obtaining maximum 
information. Suppose the subject makes a wrong 
deduction? Does he have control over this risk? He 
does not; he cannot himself either Increase or de- 
crease the risk. 
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b) Successive scanning. essentially, this strat- 
egy conslsts of testing one hypothesis atatime. A 
hypothesis is tested unti: a contradiction is reached, 
or until it is clear to the subject that the desired in- 
formation is not forthcoming. Then the hypothesis 
{s discarded, and a second is chosen fortesting. 
Notice that a hypothesis is tested independent of the 
others. 


The gain in use of successive scanning is twofold: 
1) it lightens memory load and 2) frees the subject 
from the necessity for maklng many deductions con- 
cerning the other hypotheses. Two disadvantages 
are that some of the hypotheses may overlap, lead- 
ing to repetition of work already done, and that there 
is no control over risk. Asubject cannot take 
greater gambles or lesser gambles. Thisisa rath- 
er leisurely strategy and discounts heavily any time 
factor. 


c) Conservative focusing. First of all, a subject 
who Is a conservative focuser studies the situation 
to see if there is one key idea. If there is, it ls fo- 
cused upon, and all hypotheses are tested against it. 
Suppose he finds a hypothesis that looks promising. 
That is, a hypothesis that impinges on the key idea. 
Now, he chooses those hypotheses that contain the 
same part that the promising hypothesis does. Then, 
one by one, he adds parts of these Lypotheses and 
tests the results. The ‘‘conservative’’ enters this 
strategy at this point. Only one feature of a hypoth- 
esls ls added at a time and tested. 


Much infor mation is obtained by conservative fo- 
cusing and redundancies are avoided. The risk of 
securing no Information is under control; in fact, 
one always gets some useful information. The only 
reat disadvantage Is that information which Is not 
arranged in orderly fashion might involve a tong 
search for the needed data, Thus, part of the suc- 
cess of a subject using conservative focusing depends 
upon how well organized hls knowledge is. 


d) Focus gambling. The Initial steps taken by a 
subject who uses focus gambling as a strategy are 
the same as those of one who uses conservative fo- 
cusing. But, he is not satisfied with adding one part 
of a hypothesis at a time and testing; he addstwoor 
more parts at a time and gambles. The strategy is 
not quite an all-or-nothing one, but Itcomes very 
close In case the omnibus hypothesis fails. The 
only thing to do then is for the subject to shift strat- 
egles and fall back on successive scanning. 


However, the gamble may pay off. The omnibus 
hypothc sis may lead to attainment of the objective. 
There is much gain then, of course, for the number 
of trials has been reduced to a minimum and much 
time has been saved. 


THE STRATEGIES IN USE 


IMPORTANCE OF INITIAL FOCUS 


Several years ago, the writer did a pilot study in 
which about ninety secordary-school teachers were 
involved. Two tasks, or problems, were presented 
to the subjects, and they were asked to find a solu- 
tion. The obdjective at the time was to secure infor- 
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mation on these teachers’ conceptof a mathematical 

solution, but other interpretations of the evidence 

turned out to be more interesting. Thisistrue, par- 
tleularly in view of the foregoing dlscusslon. 


Situation 1, One problem wes the following: 
From a two-digit number, N, subtract the 

number whose digits are those of N jnter- 

changed. If the difference ls a positive cube, 

how many permissible values of N are there? 
However innocent this problem appears, it is not a 
run-of-the-mlll problzm. The method of approach, 
that is, the initial focus, is critical. Practically all 
of the teachers classified the problem as a ‘‘digit 
problem.” All right; there are standard methods 
for solving a problem so categorized. These were 
applied; let t and u represent the tens’ and units’ 
digits, respectively; then 

N= 10t+u 
a positive perfect cube = (10t + u) - (10u + t). 


Quickly perceived is that the tried-and-true meth- 
ods fail. There is no place to gofromthis point, 
for at least two more equations are needed for them 
to be successful. A small number of papers were 
discarded because of errors In finding a simpler 
form for (10t + u) - (10u + t). It is doubted that this 
was fatlure of any strategy. Rather, such errors 
seemed to be the result of haste or carelessness. 
The remaining papers fell nicely into three groups. 


There were those whose Initlalfocus was all 
righi. These papers showed that the persons got as 
far as 

N= 10t+u 

x3= O(t - u) 

x>0. 

But, unfortunately, once they had made a focus, they 
were not flexible enough to change it when it led no- 
where. The papers of these subjects were covered 
with equations and tag ends of scribblings. They 
formed only sne hypothesis - secure enough equa- 
tions to solve for all of the unknowns. One might 
categorize their strategy as successive scanning, 
where there was just one hypothesls to scan. This 
was done over and over by members of this group. 
There was no change of focus withrespect tothe 
problem. Failure did not discourage them fromtry- 
ing the same hypothesis again and again. 


The second group’s papera showed fewer ser ib- 
blings. There was hardly any writing on these pa- 
pers after the inittal symbolizing of the problem sit- 
uation. Inferred from what evidence was available 
was that these subjects realized that the initlal cat- 
egorizatlon of the problem as a digit problem was 
not quite correct. They seemed tobe flexible enough 
in their focusing on the problem to change their fo- 
cus, It seemed, however, that they were at aloss 
to formulate another hypothesis or another strategy. 
A possible interpretation is that these people had a 
limited concept of a mathematical solution. Geomet- 
ric proofs and the results obtained by solving equa- 
tions qualified all right, but the result found by trial 
and error or by a verbal argument did not. 


Members of the third group not only realized that 
a shift in initial focus was necessary but they also 
had a better conceptlon of what constitutes a mathe- 
matical solution. Some adopted a strategyof 
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successive scanning, trying different pairs of num- 
bers in succession. Others ciearly used conserva- 
tive focusing, for they not only tried pairs of num- 
bers but also took into account the positive perfect 
cube datum. Those with the most elegant solutions 
used a highly sophisticated conservative focusing 
strategy. A few used focus gambling, but more due 
to the pressure of time rather than to preference. 


Situation 2, The second task presented to these 

teachers was a straight-forward geometry prob:em: 
Find, on a straight line, a point such that 

the sum of its distances from two given points 

is the least possible. 
The first step in any geometry problem is to draw a 
figure and introduce some notation. If more sub- 
jects had followed this advice, there would have been 
more correct solutions to this problem. As it was, 
only one-sixth of the subjects were able to arrive at 
a solution. Just as was the case with the algebra 
probiem, here, too, the difficulty was inflexibility 
with respect to the Initial focus. 


Let us take the key idea of the problem, the sum 
of the distance from two given points isthe least 
possible, and use it as an initial focus. Now,as one 
proceeds to make a figure and introduce notation, he 
must give 

> 


< Zz R 


Case 1 


up this initial focus for a moment and shift to focus- 
ing on the two given points. The problem says noth- 
ing about placing them; a decisionis required. 
Three possibilities, or hypotheses, appear: Case 1, 
both points are on Ilne# ; Case 2, the points are on 
opposite sides of 2 ; 


Ae 
eB 
Case 2 
and Case 3, the points ae on the same side of £ , 
eB 
Ae 
< ? 


L 
Case 3 


A shift of focus back to the least possible distance- 
focus immediately takes care of Case 1 and Case 2, 
for the shortest distance between two polnts is the 
length of the segment joining them. Now, keeping 
these results in mind, turn to Case 3 and ask ‘‘'How 
can T use this idea (the length of the segment)?” A 
few moments’ thought suggests reflecting one of the 
points in the line# , ylelding point B*. Segment AB’ 


or B 
A &,. a“ 1 
< ae > 
b D oe Cc 
ee 


intersects # In D, and D ts the desired point. Fer 


triangle BDC is congruent totriangle B'DC, and 
consequently BD = B'D. Therefore, BD + DA is the 
least possible distance. 


These two problems have emphasized the impor- 
tance of initial focus. More tnan that, discussionof 
attempts at solutions made clear how necessary it 
is for a problem solver to be flexible enough to shift 
his focus as the process of solving the problem de- 
velops. In each problem, concepts related tothat 
involved in the problems themselves were very 1m- 
portant. It seems that, at ieast in mathe matics, 
knowledge of these subsidiary concepts is crucial to 
success. The strategies uscd seemed first toe 
that of simultaneous scanning with a transfer to con- 
servative focusing after a promising ‘‘lead’’ had 
been discovered. 


SIMULTANEOUS OR SUCCESSIVE SCANNING? 


The next problem situations are relatively inde- 
pendent of initiat focus, depending much more upon 
a choice of strategy. The mathematics curriculum 
puts considerable emphasis today on a search for 
patterns, The foliowing situations are of that sort. 


Situation 3. Divide your paper Into three columns, 
In the first column there is a string of letters, and 
in the second column there is another string of let- 
ters. Now, we shall use these two strings of Ictters 
to make a new set 
K,L,M,T,W,Z | L,M,T,X,¥ | 
of letters in the third column. How were the letters 
in the third column 
K,L,M,T,w,Z | L,M,T,X,¥ | uM, 
cbtalned? Now, try to write the set of letters that 
goes into the third 
A,C,E,P,Q | A,C,L,P,Q,R,8 | 
column for these two sets. Whatgoesintothe third 
column for the follow ing twe sets 


T,U,V,W | T,U,V,W | 


Here is another example. What would you write in 
the third column? 
$,A,M,E | N,o,T | 

Is it true that, given sets in the first and second 
columns, there is always exactly one way to do the 
third column? 


What are the results if we interchange the sets 
in the two columns? Fill in the third column and 
compare the recults with what you got before. 


L,M,T,X,¥ K,L,M,T,W,Z 
A,C,L,P,Q,R,8 | A,C,E,P,Q 
T,U,V,W T,U,V,W 
N,0,7 8,A,M,E 


What did you find? 
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Situation 4. Now let us form a third column set 
in a different way. As before, we start withsets in 
the first and second columns. How was the 
A,C,E,G,H,J | B,C,D,E,F,G,T | Aud 
third column set obtalned? Now, ty towrite the 
third column set, starting 
FAMILY [EARLY — | 
with these two sets. Jet us try two more special 
situations. Is it alvays 


A,B,C, 


D,E,F,G | 
A,B,C,D 


A,B,C,D 


possible to obtaln exactly one set, given sets In the 
first and second columns? 


Let us see what the res:lts are if we interchange 
the sets in the two columns. Conupare the answers 
with those you had before. What can you say? 


B,C,D,E,F,G,T | A,C,E,0,H,J 
E,A,R,L,Y F,A,M,1,L,¥ 
D,E,F,G A,B,C 
A,B,C,D A,B,C,D 


We have worked with strings of letters Intwo dif- 
ferent ways. That is, we used twodifferent pat- 
terns to obtain the get in the third column. Compare 
these two patterns. Do they have the same proper- 
tles? How are they different? 


DISC USSION OF S.TUATIONS 3 AND 4 


The last two problem situations are quite differ- 
ent from the first two. Except that they were not 
quite str..ight-forwaid, the first two problem s.tua- 
thons ar2 representative of the mathematics program 
before World War fl. The last two are representa- 
tlve of types of problems that aiise in the new math- 
ematics program. The algebra and geometry prob- 
lems have for thelr objective getling an anawer. Af- 
ter the answer has bee obtained, there Is little one 
can dy with it, except perhaps to refine the method 
of solution It 18 not 80 much that a concept is inthe 
process of being attalned as it is that pre-estab- 
lished concepts serve as mediators in solving each 
probtiem, Consequently such problems would be rea- 
gonabl: to present only after there was some ev i- 
dence that subjects had deen at least exposed to the 
necessary mediating concerts. 


On the other hand, the third and fourth problem 
situations are representative of situations intended 
for seven- to nine-year-old aubdjects. The Intent is 
that through auch situations a foundation Is laid for 
attaining rather deep mathematical con epts - those 
of closure and commutativity in this case. A battery 
of situations of this sort can be devised that has a 
bearing on ordinary arithmetk. Of course, letters 
would not have to be wsed. One could use the boys 
and girls in a class, or colored counters, or books, 
ot any other sort of material available. An effort 
would be made to use materials appropriate for the 
age level of the class. 


Ft ie not clear to the writer that mediating con- 
cepts are brought Into play. Rather, it seems that 


solving these problem situations requires use ofa 

Strategy, one that is effective tn atlalning concepts. 
Pattern-problems such as these seem to yleld toa 

successive scanning or a simultaneous scanning 

strategy. Or, one uses a combinatlon of the two 

strategies; simultaneous scanning for gross elimi- 
natlons of parts of the strings of letters; and suc- 
cessive scanning for determination of fine discrimi{- 
natlors. 


TWO ITEMS OF RESEARCH 


Important to tne mathematics program Is knowl- 
edge concerning what types of data in problem situ- 
ations present diffleulties. Such knowledge influ- 
ences preparation of classroom materials in two 
ways. Learning experiences can be provided that 
are intended to facilitate attainment of aconcept, 
and infor mation gleaned from research studies can 
be used to schedule concepts according to age levels. 


An attempt by one person to report on all of the 
research studies conce-ned with problem solving 
would bu fooihardy. A bibliography is very long. 
Two du:coral studies have teen singled out for re- 
porting. One reason ls to underscore the fact that 
much relevant research gets lost or overlooked 
through non- publication in journals. 


POST STUDY 


In 1958, Post did an experimental study of etx fac- 
tors involved In understanding problems. His sub- 
jects were fifth- and sixth-grade pupils jn schools 
in the Metropolitan New York section of the country. 
The definition of a problem Inthe study was "a quan- 
Utative situation detcribed in words... but fa whith 
the arithmetical operations that lead tothe answer 
to the question are not expiicitly indicated’ (Post, 
1958, p. 15). The six factors were: 1) sizeofrum- 
ders; 2) superfluous numerical da-a; 9) familiarity 
of setting; 4) number of steps; 5) type cf operation; 
and 6) symbolic terms. 


Factor 4, number of steps, requires come words 
of explanation. Post defined a two-step problem 
and a three-step problem aa fcliows: 

A step in a problem solution... wasa 
simple performance of 0.:¢ of the four oper: 
ations of addition, subtraction, muliiptication, 
and division. Therefore, a problem is (a two- 
step problem) If and only if the solution of the 
problem requires a single performance of two 
different operations or two performances of 
the same operation (Post, 1958, p. 30). 

A three-step problem Is defined in a eimilar way. 


Factor 6, symbolic termr, referatothe question 
of whether using aname foranumber such as 
“twenty-six” in place of '26"' interferes witha sub- 
ject's ability to solve a problem. The names of 
the other factors are seM-explanatory. 


Two forms of a test were prepared by Post; (hese 
forma were judged equivalent by 2 jury of experts 
and Uren tested further in a plict study. Famillarl y 
of setting and non-familtar ity of setting was obtained 
from an inventory of such settings suggested by ele- 
tmentary-achool teachers. This information was 
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supplemented with evidence obtained from the pilot 
study puplis. 


The study design was such that an analysis of var- 
jance technique could be used. The error term 
*‘was composed of the unconfounded four- and flve- 
factor in‘eractions as well as the six-factor inter- 
action’’ (Post, 1958, p. 85). The two forms of the 
test were treated as two reptications of the same ex- 
periment, for examination of the test results {rom 
che two forms led to doubt that the data from them 
could be combined. The schools represented two dlf- 
ferent socio-economic neighborhoods; the subjects 
were chosen from non- homogeneous classes; and 
small sample theory analysis was used. Correct- 
ness of solution was determined from examinatlon 
of the work written by a pupil rather than from the 
correctness of the answer. For example, a pupll’s 
svlution might be categorized as correct even ifhis 
answer was incorrect. Ano.her way of saying this 
is that errors in arithmetic computation were dis- 
regarded. 


A hypothesis was rejected if the results from 
toth forms of the test indicated rejection; Lt was ac- 
cepted, similarly, if both forms Indicated acce pt- 
ance. No conclusizn could be stated tf one form In- 
dicated rejection and the other form indicaled sc- 
ceplance. 


The hypotheses on the factors of size of numbers 
and number of stepa fell in the no conclusion cate> 
gory. Sofar aa the latter (number of steps) Is con- 
cerned, it mig have been that there was a strong 
intersction between number of steps and type of op- 
eration, for the hypothesis concerning the latter was 
rejected af the one tenth of one percent level of sig- 
nificance. That is, problems Lnvolving multiplica- 
tion and division were found to be more difficult for 
the sample subjects to understand than peodlems in- 
volving addition and subtraction. 


Hypotheses rejected were those concerning super- 
ftuous numerical data, familiarity of sett!ng, and 
the already <nentioned type of operation. The hy- 
pothesis concerning syinbolic terms was accepted. 
In short, expressing numerical data in words or in 
digits had no effect on pupil’s understanding of such 
prodlems. 


BECHTOLD STUDY 


The 1963 study of Bechtold consisted of a compar- 
leon uf an experimental group with a control group 
In which the former received instruction ia work 
with prodlems containing superiluous data and the 
latter did mA, Two units from the ninth-year pro- 
gram, {neq alities and applications of equations to 
falling body problems, were chosen for instruction 
and testing. The subjects were 14- to 18-year-old 
aludents in New York City aod the surrounding Met- 
fopolMan region schools. 


The hypothesis thal instroction in handling probd- 
lems containing superflvous data (ia both inequality 
and falling body problems) had no effect on derelop- 
ing prodlem- solving ability was rejected st the one 
percent level of signv¥icance. The results with re- 
spect to variables of sex, intelligence, and age ir- 
dicated no sign¥icant differenes with respect to 


sex and Intelligence. The data indicated, however, 
that younger students seemed to benefit more from 
instruction than older students. 


RELATION OF THE POST AND BECHTOLD 
STUDIES TO CONCEPT ATTAINMENT 


it {sp clear that if there is such a thing as acon- 
cept of problem solving, then it s a very complex 
concept. Moreover, success with problem solving 
is dependent upon mediating concepts that in them- 
selves are Complex. The studies of Post and Bech- 
told, for example, underscore the importance af In- 
struction, of exposure of pupils to many different 
sorts of problems or learning experiences in order 
that they have opportunities to attain necessary sub- 
sidiary concepts. 


The fact that familiarity of setting and superflu- 
ous deta were significant factors in Post's study 
seems to indicate that puplls may have had no pre- 
vious encounters with such problems. Hence, they 
would have had no opportunity to form a concept of 
such problems, that (8, to categorize them and de- 
velop stratcgies to use In thelr solution. Since mul- 
tlplication and division In problems turned out to be 
significantly more difficult to understaod than addi- 
tion and subtraction, one infers that pupils do not 
conceptualize the former ss well as the latter. It 
may be that the methods of teaching used with mul- 
tiplication and division failed to developfirm con- 
cepts. Asaresult, pupils were unsure inthelr cat- 
egorizations when these operations were present in 
problems. 


Bechichd established that instruction in how to 
handle problems contsining superfiuoas data let to 
greater success with such problems than that of a 
control group - at least for ninth-grade algebra stu- 
dents. A teacher Is prone to extrapolate from this 
evidence and conclude that such instruction, appro- 
peiately designed, is good for almost all age levels. 
Although the study does not represent conclusive 
avicence, still it ls encouraging inthat statistically 
significant di Jerences resulted. So often an exper- 
iment that compares two procedures br, instruction 
ends with one group doing about as wellasthe other 
on tests; there are no statistically sigs ficantdiffer- 
ences in the two sets of results. The unexpected 
significant differences in Bechtold's study leads one 
to go beyord the statistics and say that experience 
with the snatysis of problems with superfluous data 
significantly affects outcomes. 


From the definition of a concepl given at the be- 
ginning of this paper, one sees that a pe son does 
mt form a concept just through maturation. There 
must be experiences in his environment that make 
his attempts to understand the environment too com- 
plex unless he forms classes - unleas he concepia- 
alizes. This is particularly true of mathematics, 
one of man’s sophisticated invzitions. Perhaps a 
child developa ''naturally'’’ some concept of count- 
ing, even inventing hisownaames in some in- 
stances. But as there are encountered larger and 
larger groups, the effort toremember number 
names becomes too much, and, if historical ert- 
Gence is valid, there is a turnin. towatd forming 
classes, groupings, and a aumera’ system is bora. 
From this point cn, present day colture dictales 
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that intenslve exposure to a varlety of experlences 

must leap-frog the historical pattern of development 
in mathematics. These iearning slituatlons cannot 

be left to chance; they must be provided; and they 

must be plar.ned carefully. Experimental evidence, 
both in the fleld of psychology - learning theory - 
and mathematical education, furnishes guidetines for 
such planning. Inturn, experimental evidence af- 
firma of denies that the planning is effective. The 

Post and Bechtold studies are examples of this two- 
pronged approach to a mathematics curriculum. 


SUMMARY 


So it is that human beings tend to deal with 
classes of things instead of Individuals in order to 
make some sense oul of thelr environment. By form- 
ing such classes cognitive strain ls reduced as well 
as the burden on memory. To form these classes, 
or calegories, or sets, a person looks for cues, of 
if you like, for characteristics that serve to distin- 
guish things eligible for meindershipinthe set from 
those that are not cligible. The point is that these 
categorizations are Inventions, and this is particu- 
larly true in a complex body of knowledge like math- 
ematics, 


To solve a problem in mathematics, subsidiary 
concepts serve as mediators. Although initial focus 
and type of strategy have important roles, an indi: 
vidual will have little success in problem solving un- 
less he has a firm grasp of the mediating concepte. 
Mathematical education speaks in terms ofa student 
mastering a concept so that it is a part of himself; 
a peychologist would speak in terms of a student {n- 
ternallzing a concept. No matter what language one 
vses, it is certain that some of the failures in math- 
ematics instruction are due to an instructor assum- 
ing his students have understood a mathematical con- 
cepe at a high level of operational thinking when in 
reallty they have a much lower level of mastery. 
They cannot apply the concept in &» unfamiliar set- 
ting. As experimental evidence accumulates from 
investigations of how people learn and from studies 
in a curriculum context, mathematical educators 
are on the one hand becoming more cautious and on 
the other more daring. /.,plying the evidence, they 
have changed the content of the curriculum and re- 
duced the amount of pure drudgery thatused to be 
the lot of every mathematics student. Assessing re- 
cent evidence, they have some doudls whether all 
stadents master the eas ly intruduction of concepis. 


Already said ia that people categorize the things 
in thelr environment. A categorization might result 
in an initial focua ona problem. fhen certa'n hy- 
pothesea are formed that are related to this initial 
foeus. Decisions on these hypothesea serve to val- 
Sdate the hypotheses. 

The sequence of decisiona made by the per- 
son en roate to attaining the concegt [ which 
may be a problem sotution or a patters} ... 
may be regarded as a strategy embodying 
certain objectives. These objectives may be 
various in kind but in general one may distin- 
cuish three kinds cf objectives: & to max!- 
mize the infot mation gained from each deci- 
ston and test of an Instance; b. to keep the 
cognitive atrain involved in the task within 


manageable or appropriate Ilmits and certainly 
within the lim'ts imposed by one's cognitive ca- 
pacity; and c. to regulate the risk of failing to 
altain the concept within a specifiable time or 
energy limit... (Bruner, et al., 1956, p, 234). 


In the examples presented of problem solving or 
nf attaining a concept in malhematics, the idea of 
{nitlat focus and flexIbillty with respect to one's fo- 
cus {8 of great tmportance. After isolating a key 
idea in a problem, a student has a choice of strate- 
gies - simultaneous scanning, Successive scanning, 
conservative focusing, or focusgambl!ng. A skilled 
problem- solver probably uses a combination of 81- 
multaneous scanning and conservative focusing. A 
beginner is likely to use successive scanning. If 
thme harasses a problem: solver, there is nothing to 
do but turn to focus gambling as a strategy. The sit- 
uation and the individual (his own experiences, bat- 
tery of concepts, and psychological make-up) deter- 
mine which strategy will be used. 


The investigations of Dienes (1963) atHarvardas 
well as that of Dienes and Jeeves (1965) in Australia 
lean heavily on the work of Bruner and Piaget. How- 
ever, thelr work goes beyond that of their predeces- 
score, making use of new research results and sug- 
gesiing refinements of the theory of learning upon 
which Bruner based his work. An Wea that Dienes 
and Jeeves, separately and together, experimented 
with is the development through ‘‘mathe matical 
games’ of the concept of igomor phisin of structures. 
Involved here fa the recognition of patterns and no- 
Heing the similarity between two sets of data and 
the structure that can be applied to both. 


Suppes (1965) has done a great deal of work with 
the major empnasis on learning models for relative- 
ty non-complex mathematical concepts. He charac- 
terizes his work by saying that it fs based upon a 
stimulus- sampling theory. Anlteresting assertion 
is thal the hypothes|s-strategy language of Bruner 
and his associates can be related to stimulus-8am- 
pling terms: ‘‘.., a strategy... correspomia pre- 
cisely to a state of conditioning and & hypothesis to 
the conditioned stimulus aampled on a given trial 
..a!? (Suppes, 1965, p. 64). 


Some psychologists dovbt the value of a mathe- 
matical psychology approach to models for human 
learning, but there is no disagreement thal much 
work needs to be done with Complex concepts in or- 
der to learn mere about individually different ap- 
proaches to attaining n.cthematical concepts, Mean- 
while, the mathematical educator mates use of 
available knowledge, apgiiea It aa best he can to the 
mathematics program, and gathera experimental 
evidence lo see the effect. H ia impossible to walt 
until definitive psychological reaearch on learning 
has been done, for the curriculum exists and must 
be modified fo fit twentieth century activities. One 
implication is clear: new psychological evidence 
shovid be broughi to bear on the curticuiem as 
quickly aa possible. Ttisinthe latter direction that 
mathe matical education is turning. 


NOTE: Sitwations 3 and 4 are modeled after almilar 
materials that appeared in the Nuffield Foundation 


Mathematica Teaching Project Bulletin No. 1, Nov- 
ember 1964, pp 4-7. 
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wammms PART III 


femme Instructional Materials and Media 


THE MEDIUM of instruction can be considered as the interface between 
the learner and the subject matter being learned. It necessarily affects the rate of 
learning and imposes limitations on the scope and sequence of the instructional sub- 
ject matter. Instruction by television has been criticized as impersonal and encouray- 
ing passivity. Yet, according to Wilbur Schramm in “Instructional Television Around 
the World" instructional television can, when properly used, provide for active 
learning experiences. in a series of case studies, Schramm reports on the use of 
television in widely varying sections of the world—from the affluent suburb to 
the developing nation. Properties and attributes of the media are discussed with 
reference to the school system, the teacher, and the student. Television is exam- 
ined as a potent mechanism of change. Schramm concludes that this medium 
works best when it is integrated into an instructional system which includes special- 
ized materials, activifies, and teaching tec'iniques. But the key to the system is 
a locol supervisor through whom students can interact with one another. 

Research dealing with the process of instruction is examined by Arthur 
Lumsdaine who points out that problems associated with instruction are in fact 
inseparable from problems dealing with learning. The close relationship between 
research on instructional media and the more general field of basic psychology 
of learning must be understood by persons purporting to do research on instruc- 
tional media. Among the general areas identified for research on the effects of in- 
struction is the “far underdeveloped research field of constructive and imagina- 
tive attempts to improve on the basis for determining what ought to be tought.” 
lumsdaine argues that determining the effects of present instructional media should 
precede the “more elegant question of what specific variables account for these 
effects." He takes the position that effective instructional media are a prerequi- 
site to meaningful basic research on these medio. This implies programs of devel- 
opment before research and suggests a basis for priorities in research and develop- 
ment. “Only when something effective has been developed, do we then have an 
adequate tool with which to conduct useful research.” 
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The question of cost efficiency which is usually not considered by 
educators is explored. Such efficiency frequently implies a measure of the level of 
proficiency achieved for a given effort with, as Lumsdaine suggests an approach 
in which the time required to achieve a given minimum level of proficiency is used 
as the dependent variable. Such a proposal hos significant implications for the 
design of Instructional objectives and instructional research as applied to selected 
subject areas. 

Lumsdaine concludes with a discussion of the standards or lack of 
standards used in the design and reporting of research studies dealing with instruc- 
tional media. 

Matching the instructional strategy to the capabiliti's of « learner re- 
quires a tutorial model of instruction. Lawrence Stolurow proposes an instructional 
sysiam in which methods and materials are individualized for the learner on the 
basis of the continuous matching of methods and materials with the aptitude, 
personality, and knowledge of each learner through the use of feedback contin- 
gencies both prior to and during instruction. Such individvalization can be achieved 
only in Computer Assisted Instruction. Stolurow summarizes a general idiogrophic 
contingency model of a cybernetic, computer based instructional system called 
SOCRATES. "It (this model) is based on the assumption that individualized instruc: 
tion should take a prescriptive-corrective approach to the use of psychological 
information in making decisions about teaching in a tutorial context.” The logic 
of instruction i: determined according to certain rules whose application is con- 
tingent on variables monitored throughout the instructional sequence, Results 
based on the idiographic model are presented with reference to the kinds of de- 
cisions made in individualizing instruction via the computer. 


mamam Instructional Television 


Around the World 


WE HAVE now in hand th? largest 
body of comparable and detailed data yet assembled 
on instructional television throughovt the world: 
twenty-three case studies of the use of new educa- 
tional media In eighteen countries, most of them tn- 
cluding teley!ston.' Iwill review three of these 
cases in some slight detail, cite » few others, and 
then try to sum up what f thLik the studies say about 
the requirements for using Instructional telerision 
effectively. 


One point I shall not belabor te that instructional 
television, used well, clearly does work. It works 
over a wide spectrum of tasks and a vartety of situ- 
ations. R works in developing ¢untries and coun- 
tries that are highly ingustria'zed. R works some- 
times very well and sometimes ordinarily. To tllua- 
trate what these Cases say adout how it works and 
under what conditions It appears to work well, twill 
enumerate three instances. 


CASE fh SAMOA 


The story of instructional television in Samoa 
realty begina with (he appointment of atough, deter- 
mined, little governor, H. Rex Lee, in 1961, buttre 
whole story ia 60 years okier than that, and deals 
mostly with American neglect of ile wards on the 
Samoa islands. The school system was os.'f one 
symptom of that neglect, bra it was a vivid one. 


The United Rates had committed itself to offer- 
ing Samoans an edocation equal in every way to that 
on the mainland. Yet the Samoan schools were in 
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one-room, openfale huts, where two classes com- 
peted with each other, fortissimo. The Instruction 
itself was the most traditional rote learning. 1 have 
been in these village schools and have heard the kind 
of choral chanting that one becomes accustomed to 
in primitive schools throughout the world. The stu- + 
dents repeat back - chant back - whatthe teacher 
gives them; indeed, this is the only kind of teaching 
possible when the teacher is untrained, little edu- 
cated, and not at all confident of his graspof the sub- 
fect matter. He doesn’t dare encourage questions 
or let the students wander away on thelr own intel- 
lectual excursions. The teacher says, ‘Class, what 
am I doing?’ 

Like one, the class chants back, ‘You > are- 
standing - on - the - mat.’ 

"Claas, what dof have in my hand?’ the teacher 
questions. 

“'You + have + e+ plece - of - chalk,’’ the class 
replies. 

Once i rose, smiled as digarmingly as possible 
at the teacher, and said "'Class what am I doing?’ 

“"You - are - standing - on - the - mat,” they re- 
sponded promptly, although f was far away from the 
mat. 

f picked up a book. This puzzled them; they could 
see it wasn't chalk. ‘What dol have in my hand?’ 

One boy ventured: ‘'You > have - a- plece - of- 
chalk.” 

They were quite unable to generalize much upon 
the reeponses they had ieatned in thelr educational 
catechism. 


The results of this kind of thing were predictable. 
The schools were supposed to be the equals of main- 
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land schools, but children graduated from the 
twelfth grade testing on the average from fifth to 
ninth grade In different subjects. The teaching was 
supposed to be in English, but little of it was, and 
many of the teachers could not speak the language 
undersiandably. The content was derivative f10m 
malniand texts, and so the children learned their 
reading vocabularles from accounts of commuter 
trains, milk men, and snowball fights. Isaw one 
elementary-school class belng drilled to remember 
that ‘The ‘Mena Lisa' isin Milan, ’’ aithvugh the sig- 
nificance of that knowledge to a Samoan child was 
not immediately obvious. Andover everything hung 
the pall of traditional rote Instruction. 


Now, how do you transform &@ traditional school 
system Ilke that, in afew years, Into a modern 
problem-solving, inqulring school system? How do 
you live up to the promise and plan to teach 1A Eng- 
lisn, with s0 few English models? That fs the prob- 
lem Governor Lee faced. 1am begging the question 
of whether the level should have been raised Ina 
few years, rather than a century; whether itwasim- 
portant to have English well taught and wellused; 
whether an excellent 12-grade school system was 
what Samoa most needed. Bul given ‘hat policy goal, 
how would you proceed? 


What were Governor Lee’s alternatives? He 
could replace all three hundred Samoan teachers 
by qualifled teachers (rom the mainiind, If he could 
recruit them. But this would have beena pniltically, 
psychologically, and ethically impossible solution. 
He could dring in perhaps one hundred teachers 
fromthe mainland. This woukd displace less than 
one-third of the native teachers and stirup less 
trouble, but would run head on against one of the 
oldest Samoan norms = that allgoforward together. 
Re could Institute a greally Increased teacher pro- 
gram. But this would require sending prospective 
Samoan teachers to the mainland for some years - 
lest they merely perpetuate the quality of the old 
school system ~ and its effect would not be fek for 
perhaps 15 years. Or he could use television to 
share a small amount of expert leaching over many 
clasarooms. And this is what he decided to do. 


But television {itself was not erough. The people 
who studied the problem saw very goon thal what 
they had to create was really a new teaching- learn: 
ing system. They had first toconsolidate the 
schools and provide adequate learning conditions. 
Then they had lo create a sort of teaching team, in 
which an excert teacher woukd give the core of the 
currkulum by television and anative classroom 
teacher would be taught to build a context of learn- 
ing activities atound the broadcast; and stil] anovher 
teacher would prepare etudy materials and exer- 
cises to fit tnto the plan. Make a mental note of 
this, decause the same conclusion Is being reached 
all over the workd - that whereas puptls leatn a 
great deal from lelevigion alone, they learn a great 
Geal more when it ts built into such ateaching- 
learning system as * have described. Nowhere in 
the world is television being used entirely alorz 
and effectively for any major instructhonaliask. Al- 
waye it is integrated into some kind of system in 
which the studio teacher, the classroom teacher, 
and sometimes others cooperate in stimulating the 
maximam amourt of learning activity in the students. 


Governor Lee persuaded Congress that our neg- 
lect of Samoan education should be repaired. Are- 
markable installation was built at Pago Pago, one of 
the finest instructlonal television Installations inthe 
world, with six open-circuit channels, ten videotape 
recorders, transmitters on a mountain top, and tel- 
evision teachers, engineers, and producers re- 
¢rulted from the States. Ciasses began to move in- 
to the new school buildings In 1964, and television 
began to carry the burden of teaching beginning 
In the autumn of that year. 


How is it working? What evidence {s there that 
television Can raise a priinitive toa modernsystem- 
Beeby’s (1966) Class I and II schools to his Class 
Til and [V schools = ina short time? 


The evidence isn't all in, yet, but the signs are 
encouraging. The Samoan elementary schools are 
working very well, Indeed. Thechildrenare speak- 
{ng much more and much better Engilsh. The tele- 
vision classes are Ilve and active; the pupils talk to 
the teacher and answer her questions Just ag though 
she were in the rcom. There is much less rote 
practice. Children are asking questlons. Some 
schools are making barometers and undertaking 
other speclal projects. I saw one sixth-gra .e teach- 
er bring in a lizard for tne class to study. They 
talk -d about the little beast, what he ate, wio ate 
him, and ® orked around to the balance of nalure. 
This could not possibly have happened cnly a few 
years ago. I can’t say that thehigh schools - which 
are using, mistakenly or not, very large classes - 
are working as well as the elementary. But on the 
whole, it is a very encouraging and hopeful experi- 
ment, one that is worth watching, 


Pause briefly, before we review the next case, 
to reflect cn what seem to be the basic elements of 
the Samoan case: a problem, large, urgent, im- 
portant enough so that many groups can rally to 
salve it; adequate support, administrative and [1- 
nancial; and the introducticn of television, not as a 
separate clement, but as a part of a teaching-learn- 
Ing system Integrating all the teachers and all the 
classroum activity. 


CASE 2: HAGERSTOWN 


Letusturn now from the fale huts and palm 
groves of Samoa to the green flelds aad active in+ 
dustries of Maryland. The United States experi- 
ment most often linked to Samoa Is Hagerstown. 
Most of you are familiar with this system, aid 1 
shall not enumerate what you more than likely al- 
teady know about ft, 


As you probably know, there were three chief 
reasons for introducing television into the Washing- 
ton County echool system, centering on Hagerstown. 
One was that school officials were anxious to make 
expert teaching of art, music, and science available 
throughout the elementary schools, and to offer cer- 
tain advanced courses, such a8 college-level math- 
emuatics in high ¢chool. To do this withresident 
teachers woukd have adced a great dealtothe budget, 
ard would have presented severe recruiting prob- 
lems. Therefore, they wondered whether i was 
not possible to share expert teaching in these 
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subjects by means of television, at a lower cost, or 

al least no higher cost, than by hiring the necessary 
specialized teachers. Inthe second place, they 
wondered whether In the coming years of expanding 
enrollments there would not be some advantage In 
designing schools, not with many rooms about the 

same Size, but rather with a central large room or 
rooms [or viewing televised classes, and a number 
of small rooms around the perimeter of the bullding. 
And, flnally, financial help was available - $1 mil- 
ion from the Ford Foundation and over $300, 000 In 
equipment from manufacturers. 


This was In 1956, Hagerstown decided, as did 
Samoa later, that lt needed the equivalent of six 
channels to leach the core of an entire curriculum. 
Because open-circuit channels were not available in 
thal number al any one polnt In the United States, it 
was decided to go closed-circuit. Coaxialcables 
were leased from the telephone company, and ex- 
tended gradually over the next few years to every 
school in Washington County. For more than a half 
dozen years, now, every student In the system has 
reczived the core of his curriculum from television. 


In Hagerstown, as in Samoa, a studio teacher 
anda classroom leacher operate as a team to teach 
content previously decided upon. The studlo teach- 
ers are chosen from the regular teaching corps of 
Hagerstown, and are changed frequently. Becaure 
all the teachers in the system are Qualified and well 
trained, there has been less difficulty, Inthe Hayers- 
town than in the Samoa experiment, in getting the 
classroom teacher to play his new role expertly. 
But two elements are generally credited with the 
smooth transition in Hagerstown fromthe older plan 
to the television teaching team. One of these is the 
{lrm support glven the project by Superintendent 
Wliliam Brish. Ina sense he playedthe role tn 
Hagerstown that Governor Lee played in Samoa. The 
second is the insisteace throvghout on involving as 
many teachers as possible and thus reducing the 
potential threat of the new method. Only about § 
percert of all the Hagerstown television teaching is 
taped, and very tittle of it ls brought infromouteide, 
Thus teaching on television Is treated as anordinary 
function of team teaching, not specially rewarded, 
and passed around among promising candidates. 


A consHerable amount of reecarch hasbeen done 
at Hagerstown, and some of the results of introduc- 
ing television have been spectacular. Remember, 
now, that thls is not a depelved school system, nor 
was it in 1956. Risarather average American 
system. But in Hagsrstown junior high schools dur- 
ing the first four years of television the average 
performance of students on a standardized test of 
arithmetical concepls rose from the thirty-first to 
the eighty-fourth percentlle, measured against na- 
tional norms, and on a standardized test of problem 
solving it rose from the thirty-third tothe sixty- 
eigth percentile. Inother words, before television, 
two-thirds of the juntor-high- school pupils of the 
country scored abore Hagerstown children on these 
arithmetic tests; after television, two-thirds scored 
below Hagerstown. in the fifth grade, during the 
first year of lelevision teaching, the averags Hacers- 
town pupil gained 1.9 years, rather than the one 
year represented by national norms. In the year 
before television was introduced, every one cd the 
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grades three through six averaged below national 
norms in arithmeilc. Within 2 years, each grade 
averaged above the nallonal norms. We have spoken 
only of arithmeilc. Not all results were as gocd as 
these, but the gains were by no means limited to 
arithmetic. Perhaps the most signiflcant verdict 
was turned in by the school board of Washington 
County who, in 1960 when the Ford grantcametoan 
end, studied the results, gave all teachers and ad- 
ministrators a chance lo express their opinions 
anonymously, and then voted without a dissenting 
voice to take over the approximately $600,000 annu- 
al cost of the television In their own budget. 


CASE 3: NIGER 


Both Hagerstown and Samoa, one might say, prof- 
ited by American know-how in television. Suppose 
now we turn to a country that has had little or no 
help from the Uniled States in television. Niger has 
only sixty-aix fully qualifled teachers - meaning 
teachers who are secondary school graduates and 
have had teacher training. There are some hundreds 
more wht have had the equlvatent of junior high 
sche! education, and still nore who have had only 
Sor G years in school. But there is siillno hope 
for adding to the resource in highly e-lucatcd and 
trained teachers until the country’s higher priority 
needs for educated people have been met. This cre- 
ates an extremely difficult situation because Niger, 
which has had only between 5 and 10 percent of Its 
school-age children in the classroom, is now trylng 
to double and soon to triple its school population, 
and especially to strengthen its secondary schools. 
The problem was, then, how to find the necessary 
number of skilled teachers. 


Acting with the advice and helpof the French 
eovernment, Niger developed a planfor using expert 
teachers In the studio and monitors inthe classroom. 
Unlike Samoa and Hagerstown, which began with all 
the elementary and secondary grades at the Same 
time, Niger began with the first grade. It began 
very cautiously, Infact, with only two schools, and 
with closed-circuit television. By the tlmethecoun- 
try’s new open-circuit television station went on the 
alr, the first-grade experiment had shaken down, 
and the television was expinded to the second grade. 
The ptan is to add one grade a year. 


Like Samoa and Hagerstown, Niger has found it 
works best to create in effect a teaching team in the 
studio and the classroom, and like Samoa it has 
found that the weakest link in the team Is the class- 
room teacher when that Individual Is not adequately 
trained. Using elementary: school- trained monitors 
in the classroom, the supervisors of the Niger pro- 
ject have tried short in-service training couraes, 
and have decided more intensive specialtraining 
is needed. One of the ways Samoa tried to solve 
the problem of helping the relatively untrained class- 
room teacher to learn his new role was by putting in- 
to every school an American principal, who worked 
wkh his teachers and served really as a supervisor. 
They also brought all the teachers to a six-week 
summer workshop each year, and conducted dally 
in-service tcalning by television, No easy way has 
been fcand anywhere to solvethis sari ‘cular problem, 
tat it has reappeared again and again in developing 
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countries where Instructional television has been 
Introduced, 


One of the distinctive features of the Niger exper- 
iment has been the continuing presence of a three- 
man research team supplied ty France - a psychol- 
ogist, a soclologist, and an ethnologist. These pco- 
ple are studying very closely the effect of tclevision 
teaching on African children who have never before 
seen teleyision, and, most of them, have never be- 
fore spoken French, which Is the language of instruc- 
tlon. Their psychological and cultural reports are 
not yet available, but they have measured the learn- 
ing results of the first year. As might be expected, 
the results were better In some subjects thanothers, 
and somewhat better for children who were a year 
older than the others. But as a whole, the televi- 
sion classes averaged well above the average per- 
formance of non-television classes. We must say 
of Niger, as of Samoa, that all the evidence has not 
come tn, but the outlook is highly encouraging. 


SOME NOTES ON OTHER CASES 


We will deal with several additionalcases ina 
more brief manner. 


You have noticed that in all three of the cases I 
have mentioned, generous financial help was avall- 
able, and In the case of the two developirg countries 
expert counsel was also freely offered. What woul! 
happen oe if a developing country tried to go it on 
iti own 


It isn’t 2 recommended procedure, but ithas been 
done. Rt was done, for example, in Arequipa, Peru. 
tn that high Andean city, a group of school teachers, 
members of a religious discussion group, decided to 
undertake a Community project. Looking around 
them, they saw that hundreds of children were un- 
able to gain entrance into the schools because of 
shortage of places for them. Hundreds of others 
had left school after Jor 4 years. They decided to 
begin with a group of the echool-leavers who had 
gone to work a8 domestic servants. Suppose that 
the employers of these children would tet them watch 
television an hour a day, they sald. And suppose 
that the proprietor of asmall local television station 
would give some free air time. And suppose that 
we were to do the teaching, andcould get help in 
preparing learning materiats. Well, all these things 
can.e true. Although with eome odjection, the em- 
ployers let their domestic servants watch television; 
the station offered up tc Uhree hours free time; the 
teachers donated their time; the priest whowashead 
of the discussion group supervised the curriculum, 
And a television school for school-learers went on 
the air without a single piid employee. Since that 
lime, the project has immensely expanded, now has 
a government contract and some paid employees, 
and offers a varied group of out-of-school Courses, 
adult courses, and 60 forth. it haa been almost 
fiercely local, resisting rather than inviting outsWe 
advice and help, and this has not been wholly to Rs 
advantage. But at least the Arequipa story shows 
that the do-it-yourself spiritis not entirely missing 
from instrectional television tn the new countries. 


We have reviewed several uses of instructional 
television in school. The Arequipa project was 
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mostly for out-of-school use. There have beena 
number of other projects of that kind, almed at ex- 
tending educational opportunities oeyond the school - 
for instance, Telescuola which provides secondary 
education for Italian childreu who do nct have sec- 
ondary schools in their areas; and the C..:cago Jun- 
lor Cotlege which for nearly 10 years now has of- 
fered a complete junior college curriculum by tele- 
vision, with the home television students doing cun- 
sistently better than classroom students onthe same 
examinations. Yelevision has been used to help 
teach literacy — in places like t..2 Ivory Coastwhere 
it has helped to train native workers to read, write, 
and speak French, and do simpie aritimetic so that 
they could be made middle-level supervisors; and 
in ltaly where about 15,000 adults annually register 
to study reading, writing, and arithmetic, with the 
aid of the famous program series, ‘*‘Never Too 
Late,’’ The trend of the evidence in literacy exper- 
imems, though, is that, whereas television can as- 
sist greatly by providing visual material, by moti- 
vating a group, and bringing a certain amount of ex- 
bectness, the real key to what happens lies in the 
ability of the group supervisor, A straw In the wind 
is that Italy, which at first used only monitors in 
its viewing groups, now usescertificated teachers - 
usually working outside school hours - for that pur- 
pose. 


One more note: from almost everywhere instruc- 
tional television has been used comes word that it 
is an excellent vehicle for in-service teacher train- 
ing. The mere example of excellent teaching tele- 
vised into a teacher's own subject ts itself effective. 
As some observers in Samoa remarked, this may 
have been the first time that some of the native 
teachers had ever seen a well-made lesson in their 
own grade level and field. Furthermore, to prepare 
the teachers for teaching an urdamiliar subjecto: 
method, like the new math, television has proved 
an excelient in-service training tool. itwas used 
for that purpose in Colombia, for exsmple, and the 
results were carefully measured. The amount of 
learning was very high, but with teachers as with 
Pupils the total amount depends greatly on what hap- 
pens on the receiving end. Thatis to say, whereas 
a considerable amount was learned from television 
alone, a great deal more was learned if the teachers 
met in groups and discussed the broadcest leseon, 
and still more if the groups had competent super- 
visors to direct the discussion. 


We have said enovgh now to indicate that instruc- 
tional televison, used well, can contribute toward 
the solution of a great variety of educational prob- 
lems ~ the need to raise instructional level quickly 
without a teaching corps adequate for the purpose, 
making wp for the scarcity of specialized or highly 
tralved leachers, extending the school beyond its 
physical boundaries, helping to teach adult literacy, 
and providing in-service training for teachers. This 
is not, by any means, to say that it always works 
well. Ecould cite some very disappointing stories 
to balance the entouragirg ones Ihave mentioned. 
But I believe we know enough now to advance a set 
of propositions as to what are the conditions under 
which it is likely to work effectively. Let me sug- 
gest some of these. 
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CONDITIONS CF SUXCESS 


(i) A problem. 


Alter twenty-three case studies, I devoutly hope 
that the next time someone comes to me for advice 
on Instructional television, he comes witha problem 
und not with a plece of technology. This is why 
some of the more spectacular examples of ase of 
television for teaching hare come Indeveloping 
areas Iike Samoa and Niger, Colombia and Feru. In 
those Cases the problems have been so challenging 
that [t has been possible to think boldly of new ways 
of solving them, and to get sufficlent support behind 
the effort. I think it is fair to say that most Amerl- 
can school systems have not felt Quite that order of 
need for television. It ls likewise true that most 
American schools whic! have tried television have 
been the schools tnat needed It least. Perhaps not 
until we turn the power of instructional televisionon 
our deprived schools (which are to be found on the 
mainland as well as in Samoa and the Trust Terrl- 
tories), or to meet the likely expansion of schooling 
from ages 3 to 20, with thirteenth and fourteenth 
grades appearing In every city ot over, say, 15,000 
people, wilweourselves be challengedto use 
the medium to its full capacity. 


(2) A teaching- learning system, 


Instructional television hasn’t worked well when 
it has been used like films = at the option and at the 
time of particular need felt by the teacher. Perhaps 
some day when we have enough inexpens've video- 
tspe recorders in the schools it may be 1easible to 
use it that way. But the way it hasworked must ef- 
fectively, whether In developing or developed coun- 
trices, is when it is integrated into a teaching-learn- 
ing system ~ not when il is used alone, or whenit ls 
used as an optional visual aid. This requirea the 
teacher in the classroo.n to learn a new role, and lo 
many teachers at first thie role may be threatening 
or unomfortable. This has been the source of most 
teacher resistance, where It has occurred. But ex- 
perience indicates that the roleneed be neither 
threatening nor unpleasant; infact, it may be more 
satisfying than the role of being the only teacher Ir. 
the classroom and in complete command of every- 
thing that happens there. Andonce the transition 
perlod Kas been passed, both teacher and student at- 
Utudes toward the new way of teaching improve atead- 
ily with experience with it. The experience of work- 
ing in a Cooperative team of aludlo teacher, ctass- 
room teacher, materials expert, and others as reed- 
ed, can be a most satisfying one, once the ro.ea are 
earned. 


I would Ilke tu digress and suggest that one of the 
old stereotypes about television teaching ~ that it is 
& passive experience for the puplls ~ isdestroyedin 
every place where instructional television Is being 
used effectively, The classea are extremely active. 
The pupils ta.t to the teacher on the tube, practice 
as directed, answor the teacher’a questions, pay as 
close altention, and, In elementary schools at least, 
seera to enjoy the experience at least as much aa 
with face-to-face instruction. The televiston-teach- 
ing-team is not an encouragement to passivity, but 
sather an Opportunity to stimalate learning activity. 
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(3) Support. 


Any Innovation needs support. Instructlonal tele- 
visior, which is expensive and somewhat disruptive 
to old roles, and which requires obedience tocentral 
schedules, needs it especially. Governor Lee in 
Samoa, who was strong and determined enough to 
meet the resistance he encountered fromcertain 
mainland teachers who did not believe in television; 
Superintendent Brish who was firm without belng 
rough; the President and other chief officials of Ni- 
ger who quleted some incipient uneasiness by them- 
selves coming to visit the experiment - this kind of 
support is priceless in the infant years of instruc- 
Uonal television. And beyond that, the financlal sup- 
port necessary to have an adequate technical service 
and an adeqvate nucleus of skilled personnel, Is 
a gine gua non. The magnificent technical equip- 
ment of Eamoa has made a difficult task mucheasier. 
On the other hand, I could tell you about small sta- 
tlons where the power Is forever falling, where re- 
celving seta are not maintained, where teachers are 
struggling vith Ilttle help, iittle feedback, scant ex- 
perience. Ido not have to tell you that there is Little 
chance of using ITV effectively under conditions Ilke 
those just cited. 


(4) Size 


There Is acertain critical mass beyond which in- 
structional television seems to make an important 
impact and works most efficiently. Part of this, & 
course, Comes from the economies of scale which 
are made possible by larger operations. Colombia, 
for example, can deliver televisionfor about 5 cents 
pez pupil hour, but it is serving a quarter of a mil- 
lion pupils. Some unit costs, where the system is 
notably under-used, run as high a8 $2 per pupilhour. 
We find that In most systems, instructional televi- 
sion 18 urder-used rather than over-used. Spectac- 
ular differences in unit costs can be achieved even 
by balancing up the Investment In programs agalnst 
the Investment in receiving equipment. This Is 
something we cannot develop in this paper, bul you 
can find detalls In the case studies. Beyond the fi- 
nancial effect, though, there ls a psychological Im- 
pact that comes with size. It is impossible not to 
take the Samoa operation seriously. It is impossible 
not to lake Hagerstown serbously. Theteachers, 
the students, the communities know it, Otservera 
have reported from several places that the very fact 
of the existence of a considerable ITV operation has 
made all derelopmental change easier in that area. 


(3) Planning. 


Let us merely say that most countri¢s and school 
systems have bumbled into instructional television. 
Many of them have wakened and lound it under the 
Christmas tree = the equipment being intended main- 
ty for entertainment or persuasion rather than edu- 
cation. Many cowntries that hare launched into tei- 
trision have been orerwhelmad by the sheer logis- 
tics of getting on the air. There has been all too 
little lime lo sit back and decide what the new tool 
might best be used for, and wha’ related changes 
might be made, and what will be required outside of 
television programs to make the new system work. 
And yet there will never be a better time, than just 
before the introduction of a powerful new teaching- 
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learning system like television, fora school system 
or a developing nation to sit back quietlyfor a while 
and consider goals and means and desirable direc- 
tions of change. 


There is no magic about instructional television. 
It 1s merely a pipeline into the classroom - away 
to share and redistribute teaching resources. And 
yet It puts a wand of potentlal magic into the hands 
of any school system that has a real need to use it 
and the willingness to learn to use it well. 


FOOTNOTE 


1. The countries (or other political units) were A}- 
glers, Australia, Colombia, Ghana, Honduras, 
India, Kaly, Ivory Coast, Japan, New Zealand, 
Niger, Nigeria, Peru, Samoa, Thalland, Togo, 


United States, UNRWA. The case studies 
have now been published under the title, New 
educational media in action: case studies for 
planners. Paris: UNESCO and International 
Institute for Educatlonal Planning, 1967, 3 
vols. An interpretive volume has been pub- 
lished with them, Schramm, W., Coombs, 
P. H., Kahnert, F., and Lyle, J. The new 
media: memo to educational plauners. Paris: 
UNESCO and International Institute for Educa- 
tlonal Planning, 1967. 
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masa Instructional Research: Some 


Aspects of Its Status, 


T WOULD LIKE to structure my pa- 
per in terms of the following maln topivs: (I) in- 
structional-media research as related to research 
on Jearning and instruction more broadly; (2) 
classes of problems which are Involved In the 
assessment of instructlonal effects, both at the ap- 
plied level and at the ‘‘basic research” level; 
and (3) some considerations +egarding the priori- 
tles of what It ls most important to do in the in- 
Structional-research field at the present time. In 
relation to the question of priorities, I will also 
revlew the status of alleged ‘‘findings’’ of hope- 
fully relevant basic research; some serious defi- 
clencies of such ‘‘f{Indings’’; and some notions con- 
cerning requirements for Improving the state of 
research practice. 


PUTTING INSTRUCTIONAL-MEDIA 
RESEARCH IN CONTEXT 


The first point I should Ilke to make Is one which 
people working in instructional-media research 
have realized in varyis.g degrees for a long perlod 
of time. Thls {s that the important problems in In- 
structlonal-media research are actually broader 
problems of research on the effects of the manage- 
ment of learning and hence basically research on 
learning. Most of the laboratory researchon learn- 
ing has at least potential, even if inrealized, rele- 
vance to the design of instructlonal materials and 
procedures. However, much of It does not seem 
very useful when one tries to apply It to practleal 
problems of instruction — as those who teach 
courses In the psychology of learning often realize 
when they attempt to apply their own principles. 


mec Arthur A. Lumsdaine 


University of Washington 
Seattle, Washington 


Most of the important problems for research on 
basic variables in instruction--i.e,, stimulus and 
response variables influencing the effectiveness 
with which instruction produces learning--have re- 
ceived some attention in the fleld of instructional - 
media research. In my optinion, In fact, more in- 
cisive research on instructional variables has, thus 
far, been done within the Instructional- media field 
than in any other context: [think that this state- 
mient is not just a reflection of a parochial bias on 
my part; rather, I think it reflects the fact that the 
encapsulation of Instructional procedures in specific 
media which are mechanically reproducible 
(like films and self-f .tructional programs) gives a 
degree of control over the variables Involved in pre- 
sentation, expositlon, Instructlon, and persuasion 
that ls very hard to achleve in other forms of re- 
search. Where a particular experimental treat~- 
ment can be Carefully and dellberately implemented 
in advance, as in a fllm In the cutting room, there 
is much less dilutlon from the concept, or variable, 
or prccedure presumably being implemented, t> its 
actual implementation in the process of Instruc+lon. 


During the past few years, I have been especially 
concerned with what has been referred to as *pro- 
grammed Instructlon."’ Like other catch phrases In 
the education and educational-research flelds (such 
as ‘‘systems,’’ ‘team teaching,” ‘ungraded,’ etc) 
this ls a term that I wish had never been popularized. 
It Is not what you call something, but the way you do 
lt that matters. Also, it has been Insufficiently rec- 
ognized that the work in the programmed- learning 
fleld needs to be considered as a special aspect of the 
broader fleld of instructional media (although some 
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of the Skinnerians don’t like to think of it that way}. 
“Instructional medla,’’ inturn, is part of the stlll 
more general field of instruction, which is aspecial 
aspect of the more general field of human learning. 
At each level lt scems desirable togoback to basic 
learning princlples where poss‘ble, as a source 
(but not the only source) of hypotheses or Sdeas for 
development and test. 


Not all of the good suggestions for effective tn- 
struction come as safe deductlons from Hull's pos- 
tulates or any other simple, single source. Such 
suggestions also stem partly from analysis of sub- 
jxct matter--e,g., lu Gagné’s analysis of learning 
sets--and partly they arlse In other ways. For ex- 
ample, in the process of developing specific instruc- 
tlonal products one learns a great deal about what 
variables seem to be important or worth looking in- 
to, One formulates hypotheses that a learning 
theorlst, as such, would never think of when one 
starts to attack specific, concrete problems in edu- 
cation. Arelated polnt which has been made in 
other contexts is that it ls generally unwise, in my 
view, for peuple who wish to do fruitful basic re- 
search in learning to get too far away fromthe 
actual problems of school subject matter, from the 
things that learners really have to learn. On the 
other hand, I also think that It ls L[mportant, In try- 
Ing to analyze the essentlals of instructional- medla 
(or other instructional) situ2‘‘ons, to have at least 
a good talking vocabulary with which to interact 
with people whose maln concern is the basic 
psychology of learning. 


Ihave stressed that the instructional-medla 
fleld, in its most important aspects, must relate 
closely to the more general fleld of research on in- 
struction and learning. However, I also emphasize 
that there are certain features of instructional 
media that make them very useful as tools for re- 
search, and also objects of research (cf. Lumsdaine, 
1963). Thus, the general property of stimulus re- 
produc lbillty {n instructional media greatly faclll- 
tates scientiflc study of instructional variables, A 
related factor is that ln producing instructional- 
media programs the implementation of instruction 
ls in the hands of a relatively sma!l number of peo- 
ple, thereby allowing less dilution tn the application 
of instructional principles, than when one tries to 
Implement these same principles by influencing the 
behavlor of thousands of classroom teachers. 
Finally, the abillty to reproduce instructional mate- 
rials widely means that application of applied re- 
search results is multiplled many fold. It is more 
reasonable to put out a large investment to improve 
the effectiveness of materials which will be used by 
millions of stutents than it is to invest comparable 
resources in research on procedures which are 
only going to be used by a much smaller number of 
students. 


SOME GENERAL QUESTIONS FOR 
RESEARCH ON THE EFFECTS 
OF INSTRUCTION 

I would Ilke now to identify some of the ques- 
tions which J think one should ask about the effects 
of instruction and which I think are logically prior 
to the formulation of specific research studies. The 
flrst question Is, ‘What skuuld the effects of in- 
struction be?’ Second, simply, ‘What are they, 


In any glven Instance?’ Third, ‘‘What accounts for 
them?’ (This ls where a great deal of research 
emphasis has been.) Fourth, ‘‘How do you predict 
them?” Fifth, ‘‘How do you improve them?’’ And 
sixth, ‘‘What [8 the cost (and ‘cost-effectlveness’) 
of Improving them--how much |s worth paying for 
a given amount of Lmprovement?’ 


WHAT EFFECTS SHOULD BE 


A number of people have pointed out that In 
evaluating instructional programs there are sever- 
al kinds of criteria used. In the report which was 
published by the Joint Committee on Programmed 
Instruction and Teaching Machines (1966) three 
classes of critersa were dlstlnguished: first, 
appropriateness of various poss!*’~ effects; second, 
the effectiveness with which sought-for outcomes 
were brought about; and third, the feasibllity of using 
the materials, Including cost. Consldering just the 
flrst two, it {s quite evident that one can do a very 
effective job of teachlng the wrong thing. (It could 
even be held that doing an ineffectlve job of teach- 
ing the wrong thing may be better.) What I want to 
call attentlon to here Is the far underdeveloped re - 
search fleld of constructive and imaginative attempts 
to Improve on the basis for determlning what ought 
to be taught. Very Ilttle effort has been put forth 
on this as compared with approaches on howto teach 
a given thlng mor» effectively, Thls applles all the 
way from kindergarten to graduate work. 


Skipping over the second questlon, consider Ques- 
tion Three: What accounts for the effects of Instruc- 
iicn? Here we have perhaps attained the stage of 
sophistication in which we turn away from unanswer- 
able questions (such as, Which are better, films 
or lectures? vr, Is conventlonal Instruction better 
than television?), and have moved to questions of 
what variables account for particular effects, That 
is, we have become better awa. ¢ of the consequences 
of the obvious fact that 2 good film will always 
beat a poor lecture and vice versa, and of the fact 
that such terms as ‘‘conventional instructlon” have 
been so poorly defined as to be almost completely 
ungeneralizable. 


Question Three gets at the attempt to manIpulute 
variables in order to see which kinds of gtimulus- in- 
put variables make a difference in instructional) out- 
somes. Obviously, if this type of research were to 
be successful in butlding an applicable science of 
learning, within the confines of a given set of Instruc- 
tional objectlves, we would then be able to better 
answer Question Four, (How do you predict the ef- 
fects of instruction?) as well as Question Five, (How 
do you improve them?). That is, we would have a 
basis ior evaluating an instructlonal program of any 
sort by looking at it, anelyzing its properties, see- 
Ing whether it conformed to characteristics of in- 
struction which have been demonstrated to be more 
effective than other forms of instruction, and thus 
would be able to evaluate, a priorl, any particular 
plece of Instructional material, or program, as to 
its effectlver. ~ 


Some of my colleagues feel that this can now be 
done with respect to programmed instruction. In 
my opinion, they are quite mistaken. For example, 
in one of Rothkopf’s (1963) studies, (admittedly one 
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‘yhich Ls too Ilmlted to be definitlve) a groupof ‘*ex- 
perts’’ (students who had recently been through a 
course in the ‘‘proper’' way to construct instruc- 
tional programs) were asked to rate seven pro- 
grams. These seven prograins all dealt with the 
same subject matter and, without the knowledge of 
the judges, their actual effectlveness in teaching 
specifled kinds of oulcomes had been previously 
determined by trying each »f the programs onseven 
randomly selected groups of students. When rated 
effectiveness in that set of seven prograins was 
correlated with measured effectlveness (as meas- 
ured by what students actually learned), Rothkopf 
concluded that the instructional effects were indeed 
**predictable’’: the correlation was minus .75. All 
that need be done was to get judges to rate them 
and then do exactly the opposite, Such data support 
the contention that the effects of instruction are not 
really very well predictable on the basis merety of 
Inspecting (he features of the instructional mater i- 
als and deciding whether they conform to the im- 
plications of a ‘‘science of learning’’ or to the ac- 
cumulated wisdom of teachers, This means that 
elther we are applying the wrong findlngs or we 
have a great deal more to find out about the effec- 
tive variables in instruction. This In turn takes us 
back to Question Two, What are the effects of in- 
structlon? 


I contend that we might well set for ourselves 
the perhaps modes! objective of finding out what we 
gre actually doing in much on-going instruction. I 
think we at least need to know what effects we are 
producing before putting such exclusive concentra- 
tion of effort into the more elegant question of what 
specific variables account fer these effects. In many 
of the studies of instructional effects, one problem 
has been the lack of significant differences, report- 
ed with dismal uniformity. This lack would have 
been predictable if the investigators had bothered to 
run an initial test of any one treatment of the instruc- 
tional materials (preferably the best), using avail- 
able criterion measures of output, Often this would 
have shown them that, infact, the whole program 
was teaching at such a low level cf efficiency that 
the Hkelihood of revealing any differences among the 
treatments was indeed very poor. All one has todo 
is to read the instructional research literature to 
find many Instances of this kind, and I must even 
admit that thls has been true of sorce ofthe studies 
which [ have been responsible for sponsoring. It is 
avery simple truth, but one which has eluded inves- 
tigators for a long time, that if we are going to in- 
vestigate factors that make instruction effective we 
have to get the instruction effective in the first 
place and thea find out something about how it got 
that way, instead of working hard at manipulating 
variables in a piece of instruction which we later 
find out is operating at a low level of efficiency. 
One of the implications of this is that the classical 
sequence of research and (then) development often 
must be reversed, In other words, one must do the 
development first; only when something effective 
has been developed, do we then have an adequate 
tool with which to conduct 2seful research. This is 
an oversimplification, of course, but it remains a 
crucial and an all-too-often ignored consideration 
tn the instructional research currently being done 
(and continuing to be supported). 


Regarding Questions Four and Five (How to pre- 
dict the effects of instruction and how to improve 
them), it may be notedthat both imply important 
kinds of purposes. However, it can be argued that 
prediction is of no use in itseif unless it can ulti- 
mately be used to bring about better instructlon, 
One way todo this is through better selection of 
existing materials (as well ag making better ones), 


The condust of adequate empirical evaluation 
studies for (uis purpose, which would requlre the 
detailed testing of every piece of marketed Instruc- 
tional material, is an extremely time-consuming 
business. It would obviously be a great advance if 
one could reliably predict which materials would be 
more effective than others, as a basis for selecting 
from available matertals within a given set of in- 
structional purposes, In any case, the ultimate ap- 
plied purpose of fun’amental knowledge about the 
influence of inu.tructlonal varfables on learning out- 
comes is to be able to know how to improve the in- 
structional product. 


4 vexing problem of instructional research for 
this pur pose concerns the extent to which the inde- 
pendent varlables named by the Investigator ara 
Idiosyncraticto him. For example, in experiments 
on ‘‘studeit participation’’ or ‘“‘varled repetition, ”’ 
(or you name it), the independent variable {s seldom 
defined in terms sufficlently operational to provide 
reasonable assurance that someone else would be 
doing essentially the same thing if he sald he were 
studying the nominally ‘‘same variab?>.’’ That is, 
for most of the pedagogical variables derived from 
either common teaching practice or learning theory, 
the epecific way in which the ‘variable’ is im ple- 
mented can turn out to be a great deal more impor- 
tant than what varlable it nominally {s, We, there- 
fore, have findings In which the ‘‘same variable’’ 
{e.g., overtness of response) turns out to have one 
effect whenexplored by one investigator and another 
effect when explored by another investigator, The 
conclusion would seem to be that, pending auch 
time as we are better able todefine what our in- 
structional varfables mean in reproducible, opera- 
tional terms, we had better assume the burden of 
demonstrating explicitly the generality of our find- 
ings. The deduction from this is that in an Instruc- 
tional experiment inwhich one manipulates a named 
variable or procedure, the critical number of ‘‘de- 
grees of freedom’’ on which generalizatlon forms 
the experiment depends is a function of the number 
of experimenters (or programmers), rather than 
the number of subjects (learners). Put another way: 
if we are really going to say that we have founda 
dependable rule or generalization about an instruc- 
tional procedure, we have got to show that we can 
write a set of instructions which will allow another 
experimenter, programmer, or teacher to create 
substantially similar effects to those we obtained, 
I know of on!y one or two studies (still unde-way) in 
which this 1s systematically being done. Inone of 
these studieg the number of instructional vehicles 
representing each treatment are written by six dif- 
ferent programmers following a given instruction, 
as against six other programmers who are following 
a different instruction. The number of degrees of 
freedom in that analysis will be something in the or- 
der of either 10, 12, 5, or 6, depending upon what 
kind of statistical test is used, but it will not be a 
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functlon of the number of students or classes that 
are taught. 


This very important point can be summarized 
simply by saying that we have to be able to show, 
in a scientifically acceptable fashlon that someone 
else can manipulate and |mplementthe variable un- 
der consideration. At present, I know of no way to 
do this, for most variables at least, except by brute 
empirical demonstration. This is one of my main 
reasons for the quotes around the word ‘‘findings”’; 
for, of the 2aperimental results on instructlon, 
very few, if any, have been systematically repli- 
cated ina way that provides thls klnd of formal 
demonstration of thelr generalizability outside of 
the particular program or programmer responsible. 


To consider Questlon Six (concerning cost and 
cost effectlveness) requlres that we first consider 
basic objectives. In terms of the klnds of outcomes 
we are trying to achleve, we have ultimately got to 
translate progress toward these objectives into 
something that Ils coet accountable. I think the 
things that have the best chance of becoming cost 
accountable are things that are correlates of time, 
rather than belng correlates of achievement level. 
For this reason and other, I think a strong case 
can be made for Skinner's contention that, in effect, 
we should use as our dependent variable the time 
to achieve aglvenmlalmum criterion of proficiency, 
rather than the levels of proficlency attained after 
a fixed number of hours of instruction as shown by 
the resulting distribution of scores. 


A related problem is that our realistic goals in 
education are often how tobring people up to a point 
where they can quickly relearn rather than to max- 
imize how much ls retained by the end of the semes- 
ter, There is simply getting to be just too much 
to know and too much to learn to keep it all on tap, 
and part of the problem of education is, increasing- 
ly, golng to be to determine how much we ought to 
get ‘kept’ in a man’s head versus how much we 
ought to help him out on the job by better informa- 
tlon sources or refresher training. We might ask 
how mucha reallstic criterion of the goodness of 
instruction ls the speed with whicha personcan 
get back upto proficiency, rather than how long It 
takes him to get there In the first place. 


A difficulty with this kind of criterlon (aside 
from the break with traditionthat It implies) is 
that it greatly increases the cost and difflculty of 
experimentation. If one is going to measure re- 
learning of paired associates, the savings method 
of the psychological laboratorles is a rather easy 
method to apply. But if one Is concerned wlth the 
learning of a subject matter Ilke calculus, instead 
of pairs of nonsense syllables, then the question 
arises: What is the material from which one does 
the relearning? I think we have to work hard on 
solving such problems, because time expended in 
order to attain or regaln acceptable proficiency 
offers the best promise of being translatable into 
cost terns. Wecan form some estimate of the 
cost of the student time and can Ilkewise estimate 
the cost of the heating for the school, the teacher’s 
tlme, etc. But how to estimate the cost of the dif- 
ference between 700 and 750 on a set of achieve- 


ment test norm <* seems much more puzzling, and 
possibly Involves tne wrong klnd of educational ob- 
jectlve anyhow. 


RESEARCH AND 
DEVELOPMENT PRIORITIES 


QUANTITATIVE PRODUCT-EVALUATION DATA 


Ibelleve that a great deal more work Is needed 
on the simple, rnodest question of assessing or 
measur lng the effects of avallable and reproducible 
instructional programs; I think this perhaps un- 
glamorous area rates a very much higher prlority 
than It ls gettIng. We need to know what we are 
accomplishing, and by and large we don't know that. 
The programmed-instructlon people have banged 
the drum for data accompanylng programs, and we 
have even set up soine s andards so that we could 
have some hope that a sort of Gresham's Law 
wouldn’t operate with bad data driving out good data. 
Yet at present I know of only a very few programs 
on which any reasonably adequate data have been 
published. Somewhat more than that number of pro- 
grams have something which purports to be data, 
but which are merely records of what a few students 
did as they went through some version (not necessar- 
ily the published one) of the self-{nstructlonal pro- 
gram. Foc the present Iwouldallocate a much larger 
share of research budget to support lowly, ‘dirty, '’ 
applled work on getting product specifications 
for avallable programs that potentially will have 
wide use, and at least relatively tess of it to what 
ere, all too often I think, furlle attempts to do fun- 
damental research. (Iain well aware that some of 
my colleagues will regard this as utter heresy.) 


THE PROBLEM OF WHAT TO TEACH 


Another act of high research prlorlties is related 
to Question One, —- What should the effects of in- 
structlon be? We have an enormous range of opinion 
onthls. We also have an increasing amount of 
knowledge to be taught and yet no ratlonal basis for 
selecting what we should teach, not only to graduate 
students in speclalizec areas and to undergraduates 
who are acquiring a “‘liberal’’ educatlon (presum- 
ably to prepare them in some fashion to deal with 
the problems of the world), but even, to a consider- 
able extent, tothe elementary-school children. The 
problem does get somewhat easler at the lower grade 
levels, as there are certaln fundamental skills 
which appear necessary; but beyond the elementary- 
school grades I think we are flying blind in terms of 
what we are teaching. A very good case can be 
made, for example, for teaching high-school stu- 
dents the fundamentals of sampling and scientific in- 
ference rather than Euclidean geometry. 


In any case, I believe it would be very helpful to 
try to do more extensive survey research to attempt 
to Identify areas where agreement and consensus 
can be reached as to what should be taught. At this 
time a very promising attempt of this kind is being 
made by a group under the leadership of Ralph 
Tyler (1966). 


I also feel that some experimental evidence could 
be quite useful in sharpening up the quest'on of what 
toteach. Many of the questions of what ought to be 
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taught are ultimately transfer-of-training ques- 
tlons. Li amore sustalned attempt were made to 
define and characierize the kinds of educatlonal 
outcomes we really want, then we could try to verl- 
fy some of the working assumptions which we seem 
to make as to what kinds of learning transfer to 
these outcomes. We would be then moving in the 
direction of an experimental attack on what ought 
to be taught. There ls, of course, so much hypoc- 
xisy In the whole field anyhow that evento get 
people to be a llttle more honest would be helpful. 
(‘The purpose of my course is to teach the stu- 
dents to think’’; but the final examinatlon consists 
of multlple-cholce questions about the facts in the 
subject matter.) Very few determined attempts 
have been made to formulate instructional course 
objectives so as to reflect in the final examination, 
as well as In the development of the course, what 
the professor professes is really the most Impor- 
tant objective of his educational endeavor. Some 
hopeful steps in this direction have been taken. 
(The last course I tau,ht got almost to first base 
in thls respect, and the next time 1 teach It I hope 
I can get a little further along. } 


EMPIRICALLY GUIDED PRODUC'T DEV =LOPMENT 


Next to a determined attempt at research on what 
should be taught, I would say the next most impor- 
tant priority within the total research and develup- 
ment sphere is not in the research fleld proper but 
in the area of development. In my opinion, a great 
deal more support than ls preeently the case should 
be devoted to empirically guided development pro- 
Jects. (The U.S. Office of Education has not as 
yet fully taken my advice on this point.) Perhaps 
one way to proceed would be to require product de- 
velopment as one element of an R and D package. 
That ls to say, if one is to conduct an experiment 
which purports to ‘test a hypothesis’ and derive 
some ‘‘fundamental knowledge,’’ and if one is 
realistically pessimistic about the likellhood that 
he will succeed in this objectlve, perhaps he might 
be asked to have a second string tohis bow. If, 
for example, all such experiments were conducted 
with actual subject matters taught in schools and 
did both of these two things, then if they failed in 
what was the nearest and dearest objective to the 
heart of the Investigator, they still would have 
accomplished something useful. That is, if one 
produced a useful package of demonstrably rea- 
sonably effectlve new Instructlonal materlals that 
were needed as a vehicle for the experimentation, 
and if this product of the research were to be made 
avallable to some appropriate distribution agency , 
then the sole product would not be confined toa 
dubious conclusion in the pages of a journal; the 
product would include an actual on-the-shelf in- 
structional item that could be used. If in addition 
a little [lluminatlon was shed on the basic dyi.amics 
of instructlonal varlables, so much the better. If 
it weren't, at least one would have a useful film, 
self-instructional program, bouk, etc. which 
would help to justify the investment that went Into 
the research project. 


Also, some studies could usefully take an exist- 
ing product, widely available and in current use, 
and use it in a research project as the vehicle for 
making experimental manipulations to inquire 


about the effects of Instructional variables. Then, 
data glving a good profile onthe actual teachlug 
accomplishments of this product could be made 
avallable In the form of product- specification data. 
This would thus provide a well-defined set of meas- 
ures, analyzed ltem by ltem. so that one would 
know which polnts of information, sklll, knowledge, 
or other behavioral outcome were increased and by 
how much by the use of the basle product in a speci- 
fled manner wlth specified kinds of learners. One 
would then at least have some uSeful product data, 
regardless of whether or not his attempt at scien- 
tiffe Inquiry on Instructional varlables were success- 
ul, 


In summary, I would tend to plug first for em- 
pirlcally- guided development studles, second for 
other evaluative studies, and (alow third} for purely 
‘basic’? research, glven the present state of the 
art. A good way to have one’s cake and eat it too 
here is to do studies which combine Investigation of 
instructional dynamics with the development or 
assessment of a product, in such a wayastocreate 
either a useful product or useful product data, in 
addition to whatever illumination may be shed on 
more fundamental, generalizable problems. 


SOME WEAKNESSES IN‘ BASIC’? RESEARCH 
“FINDINGS” 


As to the frequency or liketlhood of genuine L1- 
lumination, suppose that one applles the criterla 
uny real scientist has the right and obligation to ap- 
ply to research findings, including that of repllca- 
tlon; andthat one throws out all of the findings 
which lack any adequate guarantee of the sensitivity 
of measuring Instruments or fail to show sophisti- 
catlon about power of statlstical tests used, and 
that one throws out all of those indefensible findings 
which have proven the impossible by violatlng the 
injunction against proving the null hypothesis. One 
then gets down tothe retatively few findings in which 
significant differences are reported, of which he 
will still find that very few have been replicated. 
Of the small number of these, perhaps most are in 
the field of the role of active response of students. 
Even here, however, it Is difficult to say much 
more than simply tat some forms of student re- 
sponding under certain circumstances can prove 
quite helpful; the conditlons under which one form 
or another of responding can help how much are 
stlll far from clear. Also, there seems to be some 
pretty consistent evidence that we have probably 
underest|mated the extent to which we ought to help 
the student out by prompting; but that evidence Is 
more secure for pailred-associate learning than for 
more involved kinds of instructional materials. 


Amoregross generalization that I think could be 
supported as a kind of by-product is that most In- 
structional lessons, films, television lessons, and 
college courses try toteach more than they possibly 
can in the tlme that ls allotted them, at least on the 
frequent assumption thatthese are the sole medlum 
of instructlon. Demonstrably, elmost every instruc- 
tional program as initially presented Is found to need 
to be extended, to need to be giver. more time (or 
else its objectives need to be reduced to more mod- 
est size) when the program is tested to reveal a 
profile of what students actually learn. This can be 
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found instudy after study when the results have 
been reported in such a way that you can find out 
what was actually learned, not just in terms of P- 
value or a misleading dichotomy between “‘signifi- 
cant”? and nonsignificant findings. 


The conclusion may be a discouraging one, but 
the most important variable in the effectiveness of 
instruction all too often seems to be simply the 
amount of time which is spent in instruction. Thus, 
if one wishes to establish the importance of a pro- 
cedure one has to do a jot more than has customar- 
ily been done in ruling outnot only the null hypothe- 
sis but also what some of us have come jokingly to 
call the ‘‘erg hypothesis.’’ Too often the proce-~ 
dure3 which are shown to be better just happen to 
be also the procedures that take more time, and 
with no sensible way of refuting the skeptic who 
says ‘‘So what? Naturally, if you spend more tlme 
vou will teach more, "” 


Many of the weaknesses of the instructional re - 
search to date are, I think, due to the lack of the 
promulgation and enforcement, for so-called basic 
research studies, of adequate standards of scientific 
reporting (which we have tried to formulate for 
evaluation studies inthe Joint Committee report 
mentioned earlier). The generally poor standards 
of reporting allow the ambiguous use of terms, and 
failures to distinguish interpretations from actual 
findings, to a shocking degree in much of the educa- 
tional research literature. It is almost impossible 
to read through a set of papers in this literature 
without finding, upon examination, that many con- 
clusions stated as if they foilow from the data are 
really just some speculations produced by the ex- 
perimenter to explain what hefoundor why he didn’t 
get what he expectedto find. I am exaggerating 
only slightly. It is an agonizingly difficult task to 
attempt (e.g., Lumsdaine and May, 1965) to glean 
from research literature in the instructional- media 
fieid that it is that has actually been demonstrated. 
In many instances one {s unable to get the basic 
data necessary to find out whether the findings war- 
rant reporting, yet perusual of the available reports 
makes it clear that without going back to the basic 
data one cannot determine what conclusions, if any, 
the available data justify. One simply cannot believe, 
by and large, what one reads in abstracts, second- 
ary sources or even in primary research reports. 
And if one tries to check onthe latter, heoften 
finds that the basic data are inaccessible. 


The APA- AERA Joint Committee recommended, 
for evaluation studies, that the basic data should be 
preserved, preferably in the form of a comylete 
matrix of each student’s response to each test item, 
so that the summary resv’is can be verified. The 
value of such data precervation is twofold: (a) very 
often serious errors are made inthe data summari- 
zation; there are nothing like the uniform standards 
of checking in educational research data that one ex- 
pects in physics or in the experimental psyzhology 
laboratory; and (b) very often the findings, even if 
accurate, are recorded ina summary form that 
precludes answering relevant additional questions 
to which the original report was not addressed. By 
way of example, there is a very good a priori rea- 
gon and considerable empirical support for believ- 
Ing that the effects of different kinds of instruction 


are likely to interact significantly with intellectual 
ability, as meaSured at least grossly by IQ, Army 
General Classification Test scores, etc. Yet study 
after study appears in the literature in which only 
the over'atl data are reported, with no indication 
whatever, even though the basic data contains this 
information, of how the results interacted with, or 
were modified by, differences in student ability 
Even when differential analyses are a function of 
ability are made it is often impossible, without going 
back to the basic data, for one study to be compared 
with another which has, let us say, made one split 
on an ability measure while another study has made 
a different split, or used a different measure. It 
would be perfectly possible, and often of consider- 
able interest, to see if these studies indeed contra- 
dict or confirm each other, but a person cannot do 
it because he doesn’t have the same split on the dif- 
ferentiating variable, This often would be very easy 
to rectify if the basic data were preserved, as also 
wouk be true in other instances in which the analy- 
sis has been incorrectly performed but might be cor- 
rected by going back to the basic data. 


Clearly I believe there is great need for general 
improvement in reporting standards. As another 
example, one of tle most common errors that we 
try to teach introductory students to avoid isthat 
special form of the unprovabllity of the null hypothe- 
sis which Is exemplified in the following argument: 
Group A and B did not differ significantly before get- 
ting treatment X; they differed significantly after the 
treatment, and therefore the effect of the treatment 
was significantly different for the two groups. Of 
course this argument 1s quite Invalid; what can be 
shown rigou~ously is only that the difference between 
before and after was greater for one group than for 
another. it is quite possible to document the propo- 
sition that treatment X made more difference for 
group A than for group B but, again, the basic data 
by which this might be tested (e.g. by a second-or- 
der t-test) have not been preserved so astobe avail- 
able for making the test. 


SUMMARY 


In Summary, J suspect that the most important 
thing that can be done to improve instructional re- 
search methodologically is simply to try to clean up 
the standards of reporting and thereby the standards 
of performance for educational experiments--at the 
semantic level, at the data-preservation levei, and 
at the level of insistingon a more complete descrip- 
tion of what was actually done in the experiment. If 
this Is not done, and here I utter a Cassandra-like 
note, I believe ultimately we are going to kt11 the 
goose that is laying all the Research and Develop- 
ment Center eggs. We need desparately to cleanup 
our experiments methodologically, and to insist on 
at least the same standards of rigor for educational 
research reports and journal articles that are applied 
by the editors of the Journal of Experimental Pay - 
chology. 


I should like to add that the dependent-variable 
measures we are using in educational experiments 
are also ingreat need of improvement. For instance 
there are few studies available iii which the effects of 
instructlon or indoctrination on ‘‘attitudes’’ have 
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transcended the level of mere verbal etatements on 
a questlonnaire by the respondents as to how they 
think they were affected or how they believe they 
would behave in a particular situation. Only a few 
studies have gone beyond this. One such study was 
conducted by Mark May at Yale some years ago 
(May and Jenkinson, 1958). Instead of simply ask- 
Ing the students, May observed how students actual- 
ly behaved so as to obtain a measure of motlvation- 
al influence of two alternative forms of a film, 
George Gropper and I dida somewhat similar study 
afew years ago in which we assessed the effects of 
some television broadcasts In alternative forms pre- 
senteu over WQED in Pittsburgh (Gropper and 
Lumsdalne, 1961), Jants 2nd his associates at Yale 
have also used observatlon of real criterion behav- 
lors, instcad of mere verbal surrogates, in study- 
ing the effects of various forms of communications 
(see Janis and Feshback, 1953). 


But such studies represent only a bare start In 
the directlon of what needs to be done. That thls is 
s0 leads to a {Inat conclusion I would like to draw: 
namely, 1 think it would be much better if we would 
pick out a relatlvely small number of problems, and 
a relatively small number of standard subject mat- 
ters, for such experlmentatlon as purports to get 
Into the real dynamics of instructlonal variables, 
and stick to them and really try to pln a few things 
down by extensive varied replications with good de- 
pendent measures, Instead of striving so much af- 
ter novelty that we hop from problem to problem 
with a series of superficial studies that cannot be 
compared with each other and that really prove 
nothing, Individually as well as collectively. I be- 
Neve this can be said, as a matter of jact, through- 
out the whole spectrum of educatlonal- psych*!ogical 
research, There are those who advocate, anda 
fey. who even put Into practice, the insistence that 
Master’s theses should always be replications of 
experiments rather than attempts at new experi- 
ments. I personally think that this would bea 
healthy general practice;for instructlonal research 
1 know it would be. We need a great deal more rep- 
kicatlon and elaboration of a few putative findings 
that look falrly promising, and much less uncoor- 


dinated striving after novelty in an attempt to win 
kudos in ‘‘ploneerIng. "’ 
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ERIC 


Defects, and Needs 


mens SOCRATES, A Computer- 
Based Instructional System 


in Theory and Research 


THIS PAPER describes a cybernetic 
computer-based instructional system, SOCRATES, 
the teaching model which led to its development, and 
some of the research accemplished with it. Early 
work on non-cybernetic instructional systems {s 
described in Coulson (1962), Silberman andCoulson 
(1962), and Bushnell (1962). For a description of 
other existing computer assisted Instructional (C Al) 
systems see Stolurow and Davis (1965), Gentile 
(1965), Hansen (1966), and Zinn (1965). 


SOCRATES 


The acronym, SOCRATES, is System for Organ- 
izing Content to Review And Teach Educational Sub- 
jects. It consists of a group of student input-output 
(V/O) stations wired to a digital computer through a 
relay rack. It is a compute -based, multiple ac- 
cess, instructional system designed to meet the re- 
quirements of an idiographic contingency model of 
the instructional process (Stolurow, 1961; 1965b, 
1965c). The model defines the presumably critlcat 
categories of instruction and treats these as systein 
functions. The system permlts controlled imple- 
mentation of the model as weli as the collection of 
data which could lead to lts further development. 


Figure 1 shows the configuration of the system, 
called SOCRATES IL. It consisted of anIBM 1620 
computer with a 1311 disk for additional storage, 
plus a 1710 Multiplex and .erminal unit linked to 
several student 1/O station |, or consoles. 


Figure 2 shows some of the individual student 
VO stations, eachof which displayed 35 mm frames 
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of a film strip with a 1,500 frame capacity and pro- 
vided the learner with fifteen keys for either single 
(selected) or multiple (constructed) response to a 
display (Stolurow, 1966). 


AN IDIOGRAPHIC CONTINGENCY MODEL OF 
TEACHING 


The model of the teaching-learning process is an 
idiographic contingency conception (Stolurow, 1965a, 
1965b). It is based on the assumption that individu- 
alized instruction is a multiple stage decision proc- 
ess that is diagnostic, prescriptive and corrective 
in its use of psychological information to make de- 
clsions about teaching. While the decision process 
is basically continuous three stager canbe identified. 
In the first stage the pre-tutorial wecisions are 
made; in the second, the tucorialdecisions are 
made; and in the third, tne program revisions are 
made. In the first two stages there are two levels 
of operation which make the system highly adaptive 
to Indlvidual differences. 


Pre-tutorial Decisions 


In the pre-tutorfal stage, one set of decisions de- 
termines the assignment of each student to an Instruc- 
tional station; the other set determines the educa- 
tional program to be used in teaching a student, 


Automatic assignment. When a student enlered 


the instructional area, he could sit at any vacant 
student station each of which contained a MASTER 
Y/O unit. The MASTER I/O unit, connected to the 
computer, contained a library of materials on film 


Figure 1. 
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(1,500 frames) and each could contain a different 
library (film strip) if this seemed feasible and ce- 
sirable. Feasibility depends, in part, upon the 
amount of core storage one needs for the computer 
programs used to process each of the educational 
programs contained in a library. 


The purpose of the automatic assignment was to 
simplify and expedite the process of getting the stu- 
dent on-line with the computer. The procedure !n 
automatic assignment consisted of the following. A 
student went to any station -for example, 1, If it 
was not one at which the instructional materials 
needed were contained, he had to be directed to an- 
other statlon which had the appropriate material, 
In order for the system to do this automatically, the 
student read an initia! frame containing instructions 
to both enter his ID number uSing the keyboard and 
to press the ‘Iam thru’’ key. When he did this, 
another frame appeared on which a filmi number was 
displayed. Every film contained a unique number. 
After the student entered his ID, he entered the film 
number. The system then compared the number 
with the one it had stored as the appropriate assign- 
ment for that student, If there was a match, in- 
struction began at that station. Ifthcydidnot match, 
however, the system searched all available stations 
containing the film which the student should see and 
advised him of the one available; it instructed him 
to go there. This was done by showing hinva statlon 
number. Once the student was seated at an appro- 
priate station, the pre-tutorial phase of instruction 
began. 


Initial selection of an individual’s program, In 


order for the system to make pre-tutorial decisions 
about the student's instructional program, it is nec- 
essary to have a computer program which processes 
inforrmatlon about the educational program and about 
the student. The objectives of the instructional pro- 
gram must be stated in behavioral terms, namely, the 
type and level of performance that is required. Each 
objective is a ‘‘do statement'’; it containsa relevant 
verb and a description of content and conditions un- 
der which performance is to occur. Each film in- 
cluded frames containing: (a) information; (0) direc- 
tions (e.g. , procedure); (c) questtons; (d) response 
options; (e) knowledge of results; and (f) evaluative 
feedback. Performance requirement forcorrect 
response, expected wrong responses, and the max- 
{mum training time that can be used are all speci- 
fied. The student’s pretest scores indicate his be- 
ginning knowledge in relation to each objective, his 
aptitudes, and his personality characteristics. 


More specifically, whenever any of the student’s 
pretest scores - his entry level of performance - 
equals or exceeds tre minimum ter minal level, the 
set of frames relating to that objective is eliminated 
for that student. The remaining set of objectives 
has to be taught; to do this, the system nee:’s to be 
programmed to make the Initial decisions abou: the 
rules to be used in teaching the remaining set of ob- 
jectives. The set of decisions used in teaching is 
its instructional logic. When the logic Is expressed 
as a Set of rules for interaction with a studentor, in 
other words, when the contingenctes to be used with 
a student are decided upon, then the teaching strat- 
egy is defined and the program specified. The Ini- 
tial decision is to identify the instructional logic. 
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The flow diagram for r-ogram selection during the 
pre-tutorial process is presented in Stolurow (1967), 


Selection of contingencies. To use data about the 
student in making the decision about how toteach 


him, it is necessary to have information about the 
typical, or expected, relationship between pretest 
scores, on the one hand, and the effects of specific 
treatments such as a type of feedback or a sequence, 
on the other hand. Each of these relationships is a 
possible contingency that has to be implemented by 
the system. The desiredcontingenclies are ex- 
pressed as ‘‘if...thun’’ statements. To illustrate: 
A contingency, as a rule to be used during learning, 
states that if a student with low mathaptitude an- 
swers Correctly, then he is sent ontothe nextframe, 
but if he answers incorrectly, then he is sent back 
to the original material and must select another al- 
ternative, Thisisacorrectioncontingency. Another 
example is the aptitude-sequence contingency, name- 
ly, if the student’s aptitude scores are X, then the 
sequence of instructional material is 1, 2, 3. For 
example, if a student with high language aptitude 
correctly answers the first five questions about a 
passage just read, then the remaining three ques- 
ons in the set are omitted and he is given new ma- 
terials that he would not otherwise see. However, 
if he does not answer correctly, the remaining ques- 
tions in that set are given. Theoverall instructional 
logic is what determines the order in which the stu- 
dent would receive new materiais during learning. 
If research data show that students above a particu- 
lar level of mathematical aptitude learn to add frac- 
tions better through the RULEG sequence than they 
do through the EGRUL sequence (Taber, et al. , 1965), 
then a contingency between aptitude level and the 
RULEG sequence would be programmed and used in 
making decisions about teaching the addition of frac- 
tions, Students with scores outside that range might 
be taught with another sequencing rule, e.g., asyn- 
chrony (Detamtel and Stolurow, 1956), or class-de- 
scriptive cueing (Wulff and Solurow, 1957). 


To specify another contingency euch Student's per- 
sonality test scores can be used to determine the 
form of evaluative feedback informing him of the cor- 
rectncss of his response (Frase, 1963; Parisi, 1965). 
These are just two examples of other contingencies 
that can be used !n making teaching decisions, {dval- 
ly each contingency should be based upon data from 
research revealing that it contributes to the effec- 
tiveness of instruction. However, if appropriate da- 
ta are not available, a set of theoretical possibilitles 
can be used to specify the type of feedback, the frame 
Sequence, etc. Whenever the teaching system uses 
contingencies, it branches the course cf instruction 
at the decision points. A system can make a deci- 
sion for each student at any point in teaching and al- 
ternative contingencies can be compared in their ef- 
fectiveness to determine the value of branching. In do- 
ing this, the system ts belng used to test hypotheses 
about contingencies. Thus research needs have 
to be satisfied as well as those of application. All 
rules specifying the initial set of contingencies have 
the status of hypotheses and, as they are used, the 
system acquires the necessary data relating to their 
utility. This also means that the system provides a 
means for identifying additional contingencies. The 
instructional logic, expressed as a set of rules, [s 
the set of contingencies used inteaching a stutent 
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using « particular set of materials. In Individual- 
lzed instructlon the logic may be quite different for 
different students. The system must be pro- 
grammed to select a strategy to go with the topics 
to be taught each student. The combinatlon of con- 
tent topics and strategy makes up an Instructlonal 
program for a student. 


Automatic adjustment. The syslem must also be 


able to handle the student for whom no progress 
could be expected to produce lhe minimum level of 
performance specified by the instructor. 


Whenever the student’s dataindicate that he 
would probably not reach the instructlonal objec - 
tives by any avallable program, the system can a) 
teach the student some things to remove his def l- 
clencies; b) lower its minimum acceptance criterla 
for knowledge; c) lower the terminal objectives; or 
d) reject the student. Each of these alternatives 
can be program ued so that it ls considered auto- 
matically in terms of a predesignated priority rule. 
For Instance, if the declslon ls to improve the stu- 
dent’s proflclency, then he would be given remedial 
instructlon in one or more of the prerequisites. For 
example, the student could be assigned and gtveran 
algebra program to build up his entry behavior lev- 
el before he begins studying a statistles pregrara. 
When he completed the algebra program, he would 
be tested and his nev’ entry level of performance 
would be substituted for hls orlginal 1e vel and an- 
other devision would be made about teaching him. 


Another alternative is to change the minlmum ac- 
ceptance eriterla, The student below mlnimum-per- 
formance level on the prerequlsite knowledge test 
but high In relevant aptitudescan be glven an instruc- 
tlonal program which Is most likely to increase his 
final performance on the test of terminal behavlor. 
Doing this would Increase the proportion of failures, 
but It also would increase the absolute number of 
successes, Therefore, thls ic a decision strategy 
that probably would be used only if lt was very im- 
portant t) meet a quota of trained people. 


As a third alternative, the system can modify 
terminal objectives when it fails to find a sultable 
program. One way to modify objectives is to in- 
crease the maximum allowable instructional time. 
For each change in that parameter, the system can 
re-esthmate a student’s final performance to see Uf 
the next estimate meets the minimum terminal pro- 
ficlency level. Once the estlmated score equals or 
exceeds the minimum, the system can print this out 
so that the instructor can decide what to do next or 
it can compare the estimated time value with a new 
maximum Value. The result uf the comparison de- 
termines whether a program will be used with the 
student. A second way to modify objectives is to 
eliminate topics that have low priority. A third way 
is to lower the minimum level of performance which 
1s acceptable at the end of instruction. Eachof these 
ways nf modifying objectives can be prograramed so 
that the appropriate parameters are considered se- 
quentially and a new estimate of final performance 
obtained. The system can store the estimates from 
each of these modifications and select that one which 
provided the maximum final performance estimate. 
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The system can be programmedtooperate at two 
different levels In making pre-tulorial decisions. At 
the lower level, lt makes declslons based upona 
fixed set of rules and a fixed set of valuesfor the 
critical parameters used by thoserules. At the 
higher level, the system changes the values of pa- 
rameters according to a different type of rule, one 
which determines the priority of the parametric 
changes and then re-evaluates the sludent. The prl- 
orlty rule Itself can be variedfrom student to student 
to achleve further Individuallzatlon. For example, 
the priority rule can be made tn depend upon the rel- 
atlve size of the discrepancies between the orlginal 
eriterlon values and each sludent’s scores. 


The outcome of the pre-tutorial processing is a 
tutorial program for each student based upon data 
about hls aptitudes, abllitles, and personality. 


Teaching Program 


A teaching program is made upof two parts: Its 
logic and Its content, the particular topic or set of 
topice to be taught. The complete set of rules used 
in maklng all of the decisicns in teaching a student 
is the logle of his instruction. The content depends 
upon the student's pretest performance on a test 
cover lng the behavioral objectives of the instruction 
and hls performance while learning. Selectlon from 
the library depends upon pretest performance. If 
pretest performance on a topic ls already equal to 
the minimum acceptable flnal performance level, 
then the materlal used to teach it lseliminatedfrom 
the student’s program. Thus, the contest of the stu- 
dent’s program depends uponacontingency,. His 
program contalns only those materials which are 
necessary to teach the knowledge and skills which 
his Initial level of performance Indicated were in- 
adequate In comparison with the termina! standards. 


The functlons i:.volved in individualizing an In- 
structional program are described in Stolurow and 
Davis (1965). Of those represented the more crit!- 
cal functlons are the comparison of the student’s re- 
sponses with those expected (performance stand- 
ards), the celection of particular displays, and the 
recording of a response history for on-llne use as 
well as for course revision. 


Teaching Strategy 


A teaching strategy can be described interms 
of two types of rules used in presenting a set of 
frames. ‘The first type of rule determines se- 
quence, or order, i,e., organization of the frames 
relating to an objective. Theorder in which Instruc- 
tlonal mater lals are presented to the student is de- 
termined by contingency rules relating to aptltude 
patterns. Each element. of Instructlon ls presented 
as a frame which requires aresponse (Markle, 
1964}. There is a variety of frames, each of which 
has a different purpose. The order in which they 
are arranged can make a difference in rate of learn- 
ing and in retention (Stolurow and Lippert, 1964). 
Consequntly, the type of frame andthe sequeme in 
which frames are arranged represent important 
speciflcations for a program. Th second type of 
rule speciffes the conditions under which theframes 
are presented; for example, a picture which Is part 
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of a frame may be timed, or the medium used to 
encode the frame migut be a film, for some, or an 
audio tape, for others. A complete set of rules in- 
cludes both types, and the set employed in tcaching 
a student to reach an objective is referred toasa 
leaching strategy. For example, ayoung student 
with high mathematics aptitude might be taught with 
a RULEG sequence under the conditions of the cor- 
rection procedure and withvisually displayed 
frames. An older student who fs also high in math- 
ematics aptitude might be taught the same concept 
with a RULEG sequence under the conditions of the 
nun-correction procedure with audio tape. Each 
would be taught by a different teaching strategy. 


Data for instructional decisions. Inorder for 
the teaching program to be effective, the system 
must use appropriate data correctly. The kinds of 
data to be used are specified by the teaching strat- 
egy, or rules expressed as contingency statements. 
To make individual predictions regarding the finai 
performance of each student from his performance 
history, both the data and the rule possibilities have 
to be represented in the computer memory and used 
by the control program. In this respect the system 
operates in the tutorial mode just as it did in the 
pre-tutorial mode, 


If the predictions about final performance are be- 
low the desired level, the system should be capable 
of changing the rules it is using and the basis upon 
which the rules are selected. For example, regard- 
ing the latter point, the system after teaching se v- 
eral students using a particular teaching logic, 
should use the data they provided it to re- analyze 
and compute new Hmits. 


Whenever the student’s performance does not 
meet the specified standards, adjustments are made 
in some part of his projected program. Also the 
data contribute to the adjustments made in the deci- 
sion rules themselves for future applications to 
other students. In this way his data contribute to 
the pool of information used in making decisions 
about teaching subsequent students (e. g., Smallwood, 
1962; Lippert, 1967). Asa result of its previous 
teaching, the system learns how to teach more ef- 
fectively. 


Two Levels of Tutorlal Instruction 


Two levels of tutorial instruction are possible. 
The lower level obtains when the system is pro- 
grammed to teach with a fixed logic and a fixe / con- 
tent, e.g., a linear program (Skim:-er, 1954), drill 
and practice (Atkinson, 1967). The higher level ob- 
tains when the system is programmed toalter either 
Its logic, its content, or both, for subsequent parts 
of the instructional program depending upon the stu- 
dent’s performance on the earlier parts. An exam- 
ple of the lower level is using the logic of a linear 
program (Skinner, 1954); anther is using the logic 
of an intrinsic program (Crowder, 1960). For both 
of these strategies the content and logic must be 
specified in advance. At this levelallofthe instruc- 
tional possibilities are pre-specified including the 
types of feedback given all students. At this luwer 
fevel of tutorial instruction a CAI system provides 
a pre-specified learning environment which inone 
case ig predetermined (linear program) and in the 
other case is contingent on the previous response. 


A distinction can be made betweena pre- spec Lied 
learning environment anda iearning environment 
that unfolds. In theformer, the actualdisplays 
seen by the student are specified in kind and in se- 
quence. If the student makes response ‘‘A,’’ then 
he sees display a, etc. The system operateson the 
basis of conditionals that are of the form “‘If this re- 
sponse, then that stimulus display. ’’ All the condi- 
tionals are specified, and all students who make re- 
sponse ‘‘A’’ see display a, In the learning environ- 
ment that unfolds, all students who make response 
‘A’ do not see display a, only some of them do. 
What display a student sees is determined by raore 
than one rule, sothat display a, for example, 
could be seen by some students who made response 
‘*A’’ but not by others who also made that response. 
An example of unfolding migit be to show some stu- 
dents a frame containing the steps in the long divi- 
sion algorithm worked out with the values 360 divid- 
ed by 12, while others may see the steps of this al- 
gorithm worked out with 480 divided by 52; some 
others may see examples with decimals. Still oth- 
ers may see the example worked out inacompletely 
differert sequence, e.g., successive subtraction and 
tallying. To do this on some basis other than chance 
implies that the decision is based upon more Iinfor- 
mation about the student than that contained in the 
last response. This can be done by making available 
a response history of two, or more, previous re- 
sponses. Todo this a CAI system must be capable 
of keeping a cumulative record of responses ina 
form that makes the pertinent set available every 
time a contingency rule is to be used, 


In addition to the availability of response histories, 
the CAI system programmed for unfolding a learning 
environment alse must store inreadlly available 
form the rules for sampling the frames and the me- 
dium (e.g., audio or visual) or media to be used. 
Another requirement Is the ability to use some con- 
tingencies, but not all, with a particular student. 
Related to this is the requirement for the system to 
be able to change the contingencies for each student 
if his performance is not meeting expected stand- 
ards. This is called the feed forward concept in 
controltheory. The system looks ahead to expected 
resulte based on what has happened and what possi- 
bilities could eventuate. After loci.ing at the future 
possibilities it selects the most desirable one and 
then proceeds to do those things necessary to bring 
it about. 


One type of rule specifies the sample of frames. 
in a linear program the 3ampling rules are simple: 
all students take the same program and they all see 
the same set of frames in the same order. The sam- 
ple rule is to use the entire set of franies. 


In idiomorphic programming the learning environ- 
ment is predetermined but not pre-specified. A pre- 
determined learning environment can be generated 
in either one of the two different ways referred to 
in the previous paragraph or by using both ways. 
Each way uses conditional rules of the form, ‘If re- 
sponse ‘A,’ then use procedure a to determine the 
next display.”’ The display that appears next is pre- 
determined by a procedure which can generate not 
just one, but a number of different displays, 


One way to implement this form of conditional is 
to use 4 procedure that varies the content (e.g., the 
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numerals) but not the sequence (e.g. , the algorithm). 
A second way to Implement it is to use a procedure 

that varies the sequence, but notthe content. A 

tilrd way is to vary both, The first way makes the 

sequences or logic conditional; the third way makes 
both Content and sequences conditional. 


Another type of instructional strategy rule deter- 
mines the time Intervals. Withaj}re-specified 
learning environment of the lincar type the strategy 
rule is simple since all students go from frame 1 to 
frame 2, toframe 3, ete., and in the same order. 
The rule is simple but the value can vary since the 
time Intervals are determined by the student; he 
sets his own pace. By pre-specifying the conditions 
the only individuallzation achieved by a linear pro- 
gram is in the rate at which each student progresses 
through the material. By pre-specifying the out- 
come of each response {nan intrinsic program, all 
the branching possibilities are fixed, and each re- 
sponse alternative takes a stucent to a specific dis- 
play. The contingency that 1s pre-specified in this 
form of programming Is that be'ween the last re- 
sponse and the next display. 


The learning environment can be predetermined 
in ethll other ways. For example, the content of the 
next frames may be different depending upor, the 
correctness of the student’s responses to other 
frames on the same topic, and their sequence may 
depend upon aptitude scores, 


With the predetermined level of functioning, the 
on-line decisions made by a teaching system change 
one, or more, of the teaching rules, or the teaching 
strategy. Two Students, each making the Same re- 
sponse to frame 105, for example, might see differ- 
ent displays, experience different time intervats, 
and have information available for different lengths 
of time, etc. The information display, the sequence 
of diaplays in the set, and the timing conditions 
would be contlagent upcen sp*cifte information about 
the student's past perfirmance. One Question to be 
answered is what type of information can be used In 
making decisions. This is a research question ts 
be answered ultimatety by empirical data. Hypoth- 
eses can be formulated; for example, it ts possible 
to include apiitude and personality test scores a8 
well as seta of students’ responses to instructional 
frames during learning in the ‘if’ portion of the 
conditional statements. Whichever one, or combi- 
nation of scores is used in specifying contingencies 
for instructional decisions will depend upon the ed- 
ucatlonal programmer's hypothesis regarding the 
optimum strategy of instruction. 


When a computer-based system provides &@ con- 
tingency-detesmined learning environment based 
opon Individual differences in performance, it uses 
tdiomorphic programming. tn teaching a set of con- 
cepts the rules which determine the order in which 
they are presented may change, for example, from 
an inductive sequence to a deductive one. While any 
rule may be charged, It might be useful tu Consider 
examples in which only one is changed. For in- 
stance, only the rules determining the information 
sequence might be changed. Another example might 
be the rule epecié7ing the evaluative feedback ¢ On- 
tingentles iven the correctness of the learner's 


responses). If the student’s performance is noi up 
to expectation in correctness or in response latency, 
the system may change the rules used to teach him. 
For example, the rule being used may have been to 
give the studert reinforcement every (time he re- 
sponded within a certaln period of time. If he did 
not respond quickly enough, the reinforcemert may 
be given on cnly half of the times he responded. 
This type of teaching rule would specify the contin- 
genctes between response latency andthe subsequent 
reinforcement schedule. If the tevelof the student's 
performance is below that expected, easier frames 
may b? presented to him. This last example iilus- 
trates yet another type of rute, onc making the dif- 
ficulty of the subsequent material contingent upon 
the number of errors. 


These examples iilustrate the types of decisions 
that can be made when contingencles are predeter- 
mined but not pre-specified. Instruction is more 
individualized when instructional rules are confin- 
gent upon both the student's performance and what 
is expected of him. Whenever one or more aspects 
of the student's actual performance do not match ex- 
pected performance, anew rule isused. Whena 
new rule is used, sets of displays and/or frame se- 
quences become available that would not be ivailable 
if the system operated at the pre-specified level of 
a linear or an intrinsic program. 


Bases for Contingencies in Instruction 


This analysis of teaching as the control of the 
learning environment Is based upon the idtographic 
contingency mode! of tutorial instruction (Stolurow, 
1965b, 1965c). This model distinguishes two types 
of contingencies. At the lower level there are event 
contingencies; at ihe higher level there are rule 
Contingercles, The model is made operational in 
SOCRATES in three ways. 


Student data possibilities. The first is inthe 
runber of possibilities which the system provides 


for the use of data in making decisions comerning 
the content and strategy tobe used in the instruction 
of individual students. For instance, the student’s 
ability, aptitude, and personality, as wellas his 
knowledge or skill, can be used in making decisions 
at any point in the program. Patterns of responses, 
that is, various patterns of error arditime, nade 
during learning are included in the possibl+ student 
characteristics which the system canuse. Sets of 
these patterns are possible bases for making the 
subsequent experiences contingent upon past per- 
formance. Ris possible to use pretest perfor m- 
ance along with error and lime dataon selected 
frames as the basis for content and/or sequential 
contingencies. Consider an example of how these 
data might be used to make different decisions for 
each of two students. One student may have made 
a high pretest ecore and then gone through the pro- 
gram rapidly, making bots of errors; ancther stu- 
dent may have made a low pretest score, but gone 
through the program ‘. the same way. The first 
student might de as: amed to be careless, and, there- 
fore, given instruction designed to make him me 
careful, The second student could be assumed to 
have failed to learn be¢ause of insufficient 
ability andtherefore, tobe inneed of srp- 
plementary of remedial instruction. 


ERIC 


108 RESEARCH AND DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 


Different display possibllities. The carlier ex~ 
ample In which the system provided different conse- 


quences to students who made the same response to 
a particular frame Illustrates a second way a com- 
puler-based systein can make instruction more in- 
dividuallzed; namely, by providing different display 
possibltitles for every pedagogicaliy-slgnificant con- 
tingency. The system's adaptivity is increased by 
including in its brary a large number of possible 
displays for each response possibility. The number 
of possible displays is increased in different ways. 
One way is by writing sets of materials at different 
levels of difficulty, another is by using different 
forms of encoding to communicate information, e.g. , 
verbal versus mathematical. A third way is to sep- 
arate the informatlve material that is intended to ex- 
plain the answer from the different kinds of evalua- 
tive feedback. The example of the student who was 
responding carelessly js a situation In which the 
availabllity of separate types of feedback would be 
useful. With the separate types available [n this 
system, it would have been possibte for the system 
to tell him he was careless while also telling the 
other student who made the same response that he 
was improving. Furthermore, each student could 
be glven his subsequent instruction with another 
teaching strategy. For example, the careless one 
could be required to make correct responses before 
being allowed to goon. The other student in the ex- 
ample, however, could be branched to different 
evaluative feedback, possibly of an encouraging type, 
and then given easier material so he would have a 
higher probability of being correct. 


Either an instructional theory or empirical data 
specifies each of the relatlonships between a set of 
student characteristics and a set of display possi- 
dllities; consequently, the more display pos sibil- 
itles In the memory of the system, the more contin- 
gencies it caa handle and the more Individualized 
the instruction could be. 


The differences between the first and the second 
way in which adaptivity Is achieved lie in the range 
of unique display possibllities which each ¢ontin- 
gency .ule could generate. Furcher more, the actual 
number of display contingencles 1s larger than the 
number of frames since both the temporal interval 
between a response and a display and the duration 
of each display can be controlled separately. Addi- 
tonal contingencies are possible Uhrough the prep- 
arallon of alternative materials at different levels 
of diffleuky or of readabillty 90 thatcomprehenston 
and speed can be maintained at each student’s osti- 
mum le-el. For cxample, thecareless student 
might be shown a display for alonger period of time 
before the system accepts his next response, or he 
may have to walt longer for the next frame after he 


has responded, 


By programming the following conditions as con- 
tingencles, they can be used selectively in teaching: 
first, the difficelty or readability level of the infor- 
mation frames; second, their sequence; third, the 
temporal Inter val between responsesandieeddack as 
knowledge of results; fourth, the type of feedback 
statement used in terms of boththelr qualitative 
and evaluative nature; fifth, the achedule wsed to 
give feedback to the student; and sixth, the time in- 


terval between knowledge of results and the new 
program frame. 


Criterion possibilities. A third way in which Idio- 
graphic programming can make a system imore 
adaptive ts by using a variety of criterla in niaking 
decisions to eltier maintain or change the instruc- 
tlonal rules themselves. A flowdiagramdescribing 
a system for doing this ls presented in Figure 3. 


The program which allows the system to change 
rules on line is called the profecsor function, Bas- 
ically this is the means for determlning rule contin- 
gencies. It is to be contrasted with the ability of the 
system to function according toa! ‘ed set of rules, 
which is called the teacher function. The teacher 
function is the part of the executive program that 
specifies the conditlons for showing each one of a 
set of displays. The professor functlon is the part 
of the executive program that specifies the condi- 
tions for showIng one set rather thananother. These 
two functions are represented In Figure 3. 


The professor function alsorequires ‘lf... 
then...'’ rules, but these are rules that make the 
use of lower order rules contingent upon specific 


Figure 3. System of criteria for decision- -making 
in Idiographic programming. 
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conditions. The professor rules imply teacher 
tules. In other words, if a sludent performs either 
better or worse than expected when a particular 
teaching strategy has been used, then some, or all, 
of these rules would be changed. This means that 
at least one other teaching strategy must be avall- 
able as an alternative to che one being used. When 
an alternative is used, frames may be disp‘ayed that 
would not be displayed if the previous stralegy had 
teen used continuously. 


An example of a pair of strategy rules which 
could be «.sed by a system on an either/or basis 
would be correction procedure with an inductive se- 
quence rule or with a deductive sequence rule. In 
uSing these strategies, it is necessary to have the 
conditions specified and a criterion avaitable so that 
it is possible to determine if the student failed to 
meet the performance criterion. / isuming that he 
failed (o meet the criterion when he wastaught by 
the Inductive strategy, he would be shifted toa de- 
ductive stralegy inthe next setof frames. Inac- 
complishing this change, the criterion for the pro- 
fessor function might be ten consecutive correct re- 
sponses none of which takes more than halfa minute. 


Whenever the student Is being taught by one stral- 
egy rule, the teacher function Is In control. How- 
ever, the shift from one teaching rule to another is 
accomplished by the professor function which be- 
comes effective whenever student respons ?s fail to 
meet acriterion. Every time the student's perform: 
ance falls to meet the professor criterion, One or 
more rules of Instruction are changed. Uf a leacher 
criterion is not met, then the decision that is made 
is specified by a particular rule. The difference be- 
tween the teacher and professor furclions tan be 
made more explicit by Indicating that the use of one 
teaching rule may utilize a fixed set of instructiona) 
and feedback frames whereas the useoftwoor more 
rules may utilize additional informational and/or 
feedbac'. frames. Therefore, with an executive pro- 
gram that can make rule changes and use different 
criterla for the changes, students may see materials 
when one rule is being used (hat they do nct see if 
another one Is being used. 


Two types of criteria can be used in making de + 
cisions about insiructional rules. One type of cr i- 
terfon is @ predclermized value; it may be a value 
for errors, for time, or for a combination of voth 
of these. It Is illustrated by a conditional state ment 
such as ‘‘If the student makes thee or morecorrect 
Tesponses to this set of frames, then continue with 
the use of rule x.’" The other (ype of crit*rion is 
generated by an algorithm, or computational forsat- 
la, on Line. This latter type of criterion is nct pre- 
delermined; rather the algorithm and the natere of 
the data it uses are predetermined. Student re- 
sponse data are processed as they occur and the re- 
sult of the processing is Lhe criterion value used in 
deciding to continue or discontinue using arule, The 
following is an example using response rate. If the 
student’s rate of response increases £0 that the ral- 
wes fit a linear incremental functica within a epeci- 
fied range of variation In slope, the strategy that is 
being used to teach Alm is maintainec. If his rate 
of response does not fit a Hnear function within the 
tange of permissible variation, the strategy shifts 
to the use of stronger positive evabvatire fecddack. 


Another example of a computed criterion Is the use 
of a mean value based upon the performance of stu- 
dents who have just been taught. As each student Is 
taught, his data are used in the re-computation of 
the mean and standard deviation which become the 
new criterion in making a decision with the next 
student. In this sense the system has a memory, 
for It accumulates data on s(udents it teaches and it 
adjusts its future performance based upon the way 
in which It ls programmed to use the accumulated 
data. These are some of the ways in which 
SOCRATES can utllize response history andcriteria 
to deterniine ils future operation. Thus it functions 
as acybernetic system. A complete record of each 
response and Its latency 1s available. These data 
can be summed across topics or across students as 
desired to obtain a periurmance measure that is 
read out or used Internally by the system for educa- 
tlonal or research reasons. Furthermore, alk rec- 
ords are kept for a student rather than for a Station. 
In other words, a Student can move fromone station 
to another and the system keeps all his records to- 
gether. He can stop and start up again at any time 
and the system has immediate access to all of his 
test scores and past responsesthat it was pro- 
grammed to save. 


IMPLEMENTATION OF THE MODEL 


In order to accomplish the teaching functions of 
the idiographic contingency model, it ls necessary 
to prepare instructional materials, Including tests, 
and to write computer programs to manage the Ins 
structional materlals in order to collect the data 
and to process it. 


LOADING THE SYSTEM 


The preparation of instructional materials 
for use in SOCRATES involves two processes, One 
is photography; (he other is computer programming. 
The student looks at photographed Images of printed 
or drawn materials. These can be relatively con- 
ventional programmed instruction frames, since 
pre-tutorial decisions can be based either upon ex- 
tant Standardized tests of achievement, abllily, ap- 
titude, and personality, or upon spectally-prepared 
tests. A cornvenience of SOCRATES, which does 
not exist for some other computer-based systems, 
is that any test material prezared in conventional 
form can be photographed and used on ihe system. 
Processing materials to make them actually avail- 
able under computer control can be accomplished 
relatively quickly since they simply need tobe photo- 
graphed and then a program can te written to con- 
trol the duration and sequence of their display. The 
students’ responses are recorded and scored auto* 
matically. 


When materials are loaved on SOCRATES there 
are two perts to the coment of its library. One is 
the displayable informatton stored on 25 mm. film 
for which there is a maximum reel capacity of 1,500 
frames; the other Is the program tn the memory of 
the Computer, tot) core and disk, inwhichthe tn- 
structional strategles and student data are stored. 
It is necessary to write a computer program to con- 
trol the presentation of each frame of film and to 
protess any data 'o be used on-line. With computer- 
based systems that use a CRT display, however, it 
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is necessary to write programs wilich generate the 
test {tcms and the displays of prcgram frames. 


A more Interesting use of SOCRATES occurs 
when educational programs are prepared especially 
for the s'stem. I! is possible ¢o introduce a great 
deal more variatior in the logic of instruction with 
the system than otherwise would be possible. Fig- 
ure 4 presenis a set of very Simple flow diagrams 
associated with some research conducted with pro- 
grams especially prepared for SOCRATES (Merrili 
and Stolurow, 1956}. It also illustrates some ofthe 
discriminations that are made among materials to 
provide opportunities for flexibility in programming. 
P frames are those frames whichrepresent pro- 
grammed materials. F framesare feedback frames. 
C frames are frames which correct the student. GR 
frames are frames which provide for general re- 
view of the point covered in the P frame, and SR 
frames are frames which give specific reviews to 
the student. By providing these different types of 
frames in the film library, it Is possib'e to route 
the student through selected subsets of the min what- 
ever sequence seems most desirable. A computer 
program must be writtento do this. IK would be 
written to provide for the contingencles of a set of 
instructional rules. 


The upper left parelof Figure 4isaflow diagram in 
which a set of these frames {8 used to provide cor- 
rection and review inalesson. By correction proce- 
dure, we mean thatthe student must mak“ a correctre- 
8p. 3¢ to the material covered inthe P frame before 
he is allowed to go on to the next P frame, Uf, tow- 
ever, it is desirable to route him through a review 
frame on this same material when the student re- 
sponds in a way which the educational programmer 
feels indicates a review, the computer program Is 
written to do this. The ro-correction procedure is 
illustrated in the upper right panel. Inthis case 
the student is allowed {o go on to the next frame 
whether he is right or wrong; however, he is first 
shown an F frame which tells him he is either cor- 
rector incorrect. The use of a no-correction rule 
is typical of a Iinear programming a@trategy. 


The lower half of Figure 4s a flow chart of the 
correction procedure and of the no-correcthon pr o- 
cedure a8 each Is applied to ques*4ons in ordinary 
multiple-choice testing. The Q frame, or questton, 
now replaces the Pframe. The arrangement of P 
and Q frames on the film can be 8* up in whatever 
manner seems most efficient for us. with the strat- 
egies that are intended for the students. The loca- 
tion of the frarres in relation to eact other on the 
{film makes it possidle ‘o locate quick-; the frames 
that could follow each l' frame. The reason for this 
{s to minimize the Interval between the presentation 
of one frame and the retrieval of the next. 


The decision rules to accomplish the varlous 
strategies are frequently presented initially tn {low 
charts such as those in Figure 3. A group of oneor 
more teaching rules may be required to implement 
a teaching strategy. Similarly, a st of decision 
rules or of teaching strategies comprises a teath- 
Ing logt¢. The use of one or mure strategies Can 
de thought of as being employed at difierent points 
In the student's program to define the teaching 
strategy used with thet program. He particalar set 


Figure 4, Program flow diagrams Illustrating the 
experimental conditions of correction/review and 
no correction/review on lessons and quizzes. 
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of contingency rules is used to provide the instruc- 
tional strategy and a set of one or more Strategies 
is used to make up the teaching logi¢. ten the sys- 
tem 4s more or less adaptive to Individual student 
needs depending upon the eatent to which the partic- 
ular set used to teach a student was determined be- 
fore the student started. Wf the set was deter mined 
prior to Instruction, the system Is not as adaptive 
as if it were determined while he was tearning and 
depended upon his performance during learning. 


The research problem in naking the system 
adaptive in an effective way is to determine thecon- 
tingencies to use and the criteria so that the com- 
puter-based instructional system Is programmed to 
implement those contingencies that Instruct most 
effitiently. This Is the primary problem in the fur- 
ther development of the Kiiographic contingency 
medel. In order to solve this problem it will be 
necessary to begin by using the systems Ina less 
adaptive level than they are capable of perfor ming. 
Students with different characlerisiies will be 28- 
signed to strategies to determine their relative per- 
formance. 


Code line of library table. A code line of a li- 
brary table Is presented in Figure 5. It represents 


one of the two sets of Computer materials used to 
contro? Instruction. The library table consists of 
lines of code which determine the frame locations 
and the varlous legal buttons which the atudent may 
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Figure 5. A code lIlne from a Ilbrary table. 


ee t 
OO0O07 CBAROIIOZO50ISPIIO7O9I3 
ae a 


F c I S 
R ° N e 
A R Cc A 
M R (s) C 
€ € R i 

, & e 
5 C 
Mw f T 
B 
pf 

0 8 

" f9) 

S ti 

E e 

8 8 

a 

1 | 

T 

9 
0 % 
N $s 


use in responding to displayed material. The ilhs- 
trated code line presented in Figure 5 isfor instruc- 
tlonal frame number 7of a program. This is indi- 
cited on the left by the number 0007. Assoclated 
with each instructional frame fs a setof lettered al- 
ternatlves each of which ia specified by a rule that 
is part of a teaching strategy. Each letter in the 
code line Is associated with a frame addreas to 
which the student will be taken if he makea that re- 
sponse. Hf, for example, he makes the correct re- 
sponse, ‘'C'' in this example, the filmis moved 
elevenframed forward. ‘‘C’'isacorrect response. 
The correct response alternatives are alwaya listed 
before the incorrect ones, and after the first one 
the other correct alternatives are starred. There 
is only one correct response in the example. After 
"CC," the letters ‘B’’ ‘A’ “'R" appear. Eachis an 
allowable Incorrect response. Hany other key is 
used it results In no change in the display. 


In addition to the library table there is the co m- 
puter program which actually manages the move- 


ment of the program frames and the times of display. 


The various strategies end levels of adaptivity pre- 
viously described can be accomplished through the 
use of these two sets of rraterials. 


RESEARCH 


Some of the research which relates to the idfo- 
graphic model follows. While the model specifies 
the lypea of contingencies that appear tobe m .ficlent 
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for the design of adaptive learning environments, the 
exact nature of the contingencles which will maxi- 
mire the rate of learning remains to be deter mined 
by research. Some studies which have provided tn- 
formatlon about contingency relationships canbe de- 
scribed briefly. Since they are insufficient to docu- 
ment all of its facets, the studies mainly provide 
support for the general validity of the model. 


THE EFFECTS OF SEQUENCE UPON APTITUDE 
REQUIREMENTS FOR LEARNING 


A matrix of Inter-correlations between a partic- 
ular set of aptitude scores and the gain scores re- 
sulting from a learning experience indicates the ex- 
tent to which the gains can be predkted from the 
varlous aptitude scores (DuBolse, 1962). The sig- 
nificance level of each correlation Indicates whether 
the aptitude is or Is not a significant factor in deter- 
mining the gain score which students make. If stu- 
dents are randomly assigned to different teaching 
strategies, and a single set of aptitudes ig related 
to the gains made, then differences in the correla- 
tions Indicate that an aptitude is involved inlearning 
ander one strategy but not under another. Thistype 
of information relates to the diagnostic aspect of the 
model in that the correlations would Mentify the ap- 
titudes that could be used In assigning students to 
the instructional strategy that willresult in the 
greatest galns. H the strategieaconsix’ of rulea 
that determine the frame sequence, then the studenta’ 
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aptitudes could be used to determine their optimum 
sequence. 


One characteristle of teaching materials which 
can be made contingent upon aptitude Is the sequence 
of frames presented to the student. If studles show 
that the size of the correlations between particular 
aptitudes and learning scores varles when different 
sequences of P frames are used so that some stu- 
dents do well when they learn with one sequence 
while others do well with a different sequence, itcan 
be assumed that there is a rule that determines the 
sequence which would be best to use for a student 
wh. ls relatlvely high in a particular aptitude and 
retalively low In another, Research revealing that 
aptitude-galn correlations do change when different 
stralegies are used provides support for the Ldio- 
graphic contingency model. Lf aptitude-gain corre- 
lations do net change significantly, then this type of 
model would be inappropriate. 


Asynchrony as a measure of sequence. One prob- 
lem that arises inusing a diagnostic- prescriptive 


approach ft the lack of critical information. Critl- 
cal information might be obtained through the use of 
varlables in research that can be implemented in a 
relective way. For example, if frame *zquence is 
to be manipulaled selectively ther ic ls important to 
have the rules for manipulating sequences soformu- 
lated that they can be impleinented easily. There- 
fore, the way in which the sequence of frames, or 
displays, is characterized Is important. The con- 
cept of asynchrony as applied to critical and non- 
critical stimulus elements appears to be quite use- 
ful for this purpose (Detambel and Stolurow, 1956). 
Asynchrouy can be exemplified in the following illus- 
tration involving color, size, and shape. If al} 
frames {na program use color, size, and shape of 
a set of objects and the student is learningaconcept 
invelving one of them, such as color, then color Is 
the criticai cue. Consider some of the things that 
happen in going from frame to frame in a sequerce. 
The color may change from one frame to the next- 
for example, from red to blue ~ but the size and 
shape may not. In this example, not only are color 
and size asynchronous with respect to one ancther, 
but also color and shape are asynchronous, If this 
pattern of asynchrony existed in a program, thenas 
the learner went from one frame to the next, color 
would change but neither size nor shape would change. 
It is highly antikely thatthis set of relationships 
would contlnue indefinitely, but that is not the point 
belng made at this time. The point being made is 
that for a series of frames it is possible to look at 
changes in critkal characteristics and determine 
what other characteristics a.sochange or donot 
change. In this way It is possible to determine the 
number of pairs of changes in stimulus characteris- 
tics which take place in going from one frame to the 
hext one, If one characteridtic, such as color, ts 
critical to what Is being taught, and other character- 
istics are hot, then two different types of asynchro- 
hous sequences can be identified. One consists of 
asynchronous sequences in which a critical (eature 
changes but a noncritical one does mot. This can 
be called a CC type of asynchronous sequence since 
the critical characteristic changes. A second asyn- 
Chrohous sequence exicts when acritialfeature 
does not change but a noncritical feature does, This 
can be called a CNC type of asynchronons sequence, 


Two opposite types of sequences also Can exist. 
These are called synchronous sequences, One type 
occurs when both a critical] feature andanoncritical 
feature change; the other occurs when neither 
changes, or, in other words, the display isrepeated., 
These ways of characterizing sequences have been 
founc to be useful In organizing materials in several 
studies (e.g., Detambel and Stolurow, 1956; Stolu- 
row, 1956; Stolurow, Fogel, and Fogel, 1966; An- 
ey. 1966) and recently in Germany by Kotter 
(1965). 


These concepts are treated more extensively in 
Stolurow (1956) and in Garner (1962). 


The use of class-descripive cues. The measures 
of asynchrony, while reliable for a particular frame 
sequence, do not, however, Identify aunique se- 
quence of frames. Using the same set of frames it 
Is possible to make up different sequences which 
have the same amount of asynchrony. Inother words 
if a Sequencing rule were used by acomiputer to gen- 
erate an asynchronous Sequence the computer would 
not necessarily generate the same sequence each 
time the rule was used, However, in all cases the 
frequency with which CC andCNC typesof sequences 
occurred would be the same. Since this is s0, It is 
useful to differentiate among sequences with the 
same asynchrony value. A way of doing this is to 
use the concept of class-deseriptive cue (Stolurow, 
1956); any feature that does not change {rom one 
frame to the next frame within a subset of two or 
moie frames of a program can function as a class: 
descriptive cue. Therefore wherever there is more 
than one feature that can be useful to the learner, 
the frarnes should be organized into subsets with a 
class-descriptive cue that is related to one of the 
objectives of Instruction. The data thusfar collect- 
ed indicate that the use of class-descriptive cues in 
organizing displays does facilitate learning (Stol- 
urow, 1956; Wulff and Stolurow, 1957}. 


The effecis of sequence changes on the relation- 
ship between aptitudes and gains. An asynchrony 


tule in combination with a cve-organizing tule can 
produce sequences that provide class-descriptive 
cues for the learaer. This teaching logic appears 

to be a useful way to synthesize a program of in- 
struction. 


Two studies will be reported here to indicate the 
results of this approach. tn both studies analyses 
were made of the data to determine the resulting re- 
lationships between agtitude and galn scores when 
different sequences of the same frames were used 
for Instruction. 


The first study was conducted by Cartwright 
{1962}. He used a fractions program whichwas pre- 
sented to mentally- retarded students during second- 
ary-level instruction. Two varlations of the instrue- 
tenal materlal were prepared. InOne program 
there vas a systematic increase and decrease ol the 
humerator and then the denominator of the fractions 
presented to the student as he went from fra.ne to 
frame. In the other alternative, which was made 
wp with the same frames, the sequetze used did not 
maintain this relationship, The comparison of the 
two groups was therefore between a program eith a 
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TABLE 1 


CHANGES IN CORRELATIONS BETWEEN APTITUDE AND LEARNING SCORES FOR DIFFERENT 
SEQUENCES WITH EQUAL AMOUNT OF ASYNCHRONY (CARTWRIGHT, 1962) 


Sequence with Systematic Sequence with Non- systematic 
Individual Incren:ent and Decrement Increment and Decrement 
Characteristics (N = 20) (N = 16) 
Mental Age - WISC 
Verbal 02 -. 26 
Performance 26 -, 50° 
Total oe -,49° 
Menta: Age - Binet 18 -,49° 
Language Aptitude ~12 -, $4° 
"p<.05 
Class-deseriptive cue and one without a Class-de- lables which differed slgnifleantly for the two de- 
scriptive cve. Some of the data are reported in grees of asynchrony. While there were other sig- 
Table 1. nificant differences between the effects of these two 
sequences in addition to those shown inthis table, 
Cartwright found, for example, using a total 4 these differences lllustrate the point that changes 
telligence test score from the WISC, that a. 17 cor- {n asynchrony can alter the aptitude requirements 
retation existed with final achievement or gain for achievement. 
scores under the class- descriptive cue (CDC) condl- 
thon; whereas a Correlation cf -, 49 was achteved The data from both studles support the idlograph- 
with a sequence that did not have aclass-descriptive ie contingemy model described earlier. They tndi- 
cue. With the Binet intelligence test scores com- cate that effective indlyidualization of instruction can 
parable correlations were obtained, namely, . 18 be accomplished by using teaching rules that offer 
and -,49. Even more interesting ts the pair of cor: Instructional sequences which fit the aptitude char- 
relations with the verbal aptitude test: a positive acteristics of each student. The use of sequencing, 
correlation of . 12 was obtained with the CDC se- and particularly of asychronous sequencing with 
quence and a -. $4 with the other sequence. These CDCs needs to de studied further to determine the 
data Indicate that verbal aptitude becomes more or sequencing rules which are sorelated to the stu- 
less significant as a contributor to learning depend- dents’ aptitudes that the best match for maximizing 
ing upon the sequence in which theframes of the his performance is achleved. The research prob- 
program are presented. lem facing us now 18 to determine the specific kinds 


of relationships or@ needs to take intosccount In 


méhing the best match between aptitudes end rules 


The difference in the correlations for the two se- for generating particular sequences of fremes. 


quence. Indicates that It is possible within a 30- point 
1Q range, from 53 to 89 In tis case, to predict from 


elther the gcneral intelligence measure of the ve r- THE EFFECTS OF VARIATIONS IN ENCODING ON 
bal aptitude measure what the residual scores of APTITUDE REQUIRE ME‘iTS 
students will be under the non-CDC sequence. This 
nieans that with the CDC sequence neither intelli- Another aspect of a teaching strategy isthe form 
gence nor language aptitude playa a algnificant role of symbol used to express a set of conce,£s or, in 
in deter mining the residual scores within thia range other words, the encoding employedto communicate 
of ability. With another aequence, bowever, these the concepts to students. A recent study (Stoluro#, 
abilities played a more important part in deter min- Frase, and Odell, 1966) of encoding differences em- 
ing what the acudents learned. ployed two different sets of notation in teaching logle 
to college students. Ore program used the Peano- 
A second study, dealing with sequence difier- Russell notation system, the other the Polish nota- 
ences and atso employing a fractions program, but tion system. In all other teagsects the two pro- 
a different one, was cor.ducted with normal studenta ftams were Hentical. nus, any variations in out- 
in elementary Schools in Champaign, Illinois. This come could be attributed to the encoding differences. 
study was completed recently and revealed a pattern 
of relationships between aptitudes and learning as a The first set of results (Table 3) indicates rather 
result of sequence differences which waa similar to clearly that ender the Pcano-Russel notation system 


that reported In the Cartwright atudy. Table 2 sum- | American students perform in a manner thal {8 pre- 


marizea the set of Correlations between pairs of var- Gictable from a set of aptitude testa. Comparadle 
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TABLE 2 


CORRELATIONS RETWEEN IQ AND PERFORMANCE AND BETWEEN SPECIFIC AP TITUDES AND 
PERFORMANCE FOR DIFFERENT DEGREES OF ASYNCHRONY (UNPIBLISHED STUDY) 


Oooo OEE ——eEEeeeEeeaEeaEEeaes=SaQaaeaeEeEeE=S=SSS SESS _—_ nn —e_aee_S—S eo oe e_ee_—oeeseeeeee ee _— 


Variables Sequence with Less Asynchrony Sequence with Higher Asynchrony 
California Test of Mental Maturity 
Total IQ and Gain Score +.01 +, 13° 
Non-verbal IQ tnd Gain Score -.13 +, 55° 
lowa Test of Basic Skills 
Spelling and Gain Score -.92 +, 56¢* 
Stanford Achievement Test 
Arithmetic and Gain Score +. 46 +, 704¢ 


ee 
* and **: The two correlations are significantly different [rom each other; *p <. 05; **p< 01 


TABLE 3 


CORRELATION OF DIFFERENT APTITUDES WITH PERFORMANCE ON A TEST COVERING IDENTICAL 
CONTENT TAKEN AFTER LEARNING THE POLISH OR PEANO- RUSSELL NOTATION 


A ptitudes for Inductive 

Group Vocabulary Mathematics Reasoning Inference 
es ee 

Peano- Russell .27¢ A) hd ite 01 
Poligh . 09 18 -.0) 01 

ee ce eae nee ee ee ee rene ere 

"9 <.05 **9<.01 

students, when trained with the Polish notation sys- to the Polish system for students trained in proc- 
tem, however, achieved gains which did not corre- essing the English language. 

late significantly with the same aptitude tests. Thus, 

it appears that these aptitude measures are predic- THE EFFECTS OF VARIATIONS IN EVALUATIVE 
ting tie processing skills which are required o€ the FEEDBACK ON PERSONALITY REQUIREMENTS 
learner by the symbol system used toencode the 
concepts snd not the actual learning of the logical Still another set of contingencies ertaining tothe 
toncepts themselves. This seems tn de arather model are those relating personality characteristics 
clear finding since the corcepts of logic were Iden- of the learner to his perfor mance gains when differ- 
tical in the two programs. The processing skills ent Conditions of evaluative feedback, or social re- 
which are required to decode the symbols reprecent- {nforcement, are employed. Soclal reinforcement 
Ing these concepts appear to de quite different. De- in these s‘udies means evaluative feedback state- 
coding the Polish expressions requires thata person mem, which tell the student about the quality as 
trained to process English and mathematics state- wellas ‘he correctness of his response. Thus, ap- 
ments be able totranspose symbols in order to proval coud be expressed in evaluative statements 
make sens¢ out of the displays presented to the stw- suchas, “Excellent, you are coming along fine," 
dents. These data indicate that one canteach the or “Right on the button’; for negative evaluation, 
same set of concepts to students by two different, or reprcol, evaluative statements suchas ‘No, you 
but presumably equivalent, encoding systems and In are not thinking,"’ ‘No, what a silly mistake to 
Going 80 can change not only the aptitude requice- make"’ express the attitudes. 

ments for learning but also thetransfer effects 

which the training produces. The data also indicate Each of these kinds of statements was given to 
thal the Peano- Russell nctation system is superior dilferent groups of stodents all of whom studied the 
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TABLE 4 


CORRELATIONS BETWEEN PERSONALITY VARIABLES (a) PERFORMANCE, (b) ATTITUDE AND (c) TIME 
UNDER FOUR DIFFERENT CONDITIONS OF SOCIAI, REINFORCEMENT (FRASE, 1965) 


Aggresslon/ Ageressicn/ Deference/ Deference/ 
Group Performance Attitude Attitude Time 
Condition 1+ 18 . 24 -,05 .O7 
Condition 2 + -.44° -, 50° -.06 . 48* 
Conditlon 3 - 35 .Tgtee -,59* 37 
Conditlon 40 >. 50° -.16 . 00 -.40 
p<. 05 99 < 005 


same basle program In logle (Frase, 1963). Group 
one (+) had correct and incorrect responses eval- 
uated. Group two (+) had only their correct re- 
responses evaluated. Group three {-) had only their 
Incorrect responses evaluated, Group four (0) had 
no evaluation of elthercne, just knowledge of results. 


In Table 4, three sets of correlations are of in- 
terest, One set is between personality test scores 
and learning scores (e.g., aggression/perform- 
ance); a second Is between personality scores and 
altitude (e.g., aggression/attitude); and a third set 
is between personality and learning time. All three 
sets revealed that each ot the four experimental con- 
ditions of social reinforcement was most suited to 
a different personality group, Three personality 
Characteristics, aggression, deference, and intra- 
ception (Murray, 1938) were found to be important 
in relation to performance under the four different 
conditions of social reinforcement. For example. 
students who were high in aggression performed 
best when they were given negative evaluation of 
thelr wr responses ard not given positive evalu- 
atton of their right responses, Under * #0 condi- 
tons = number 2, positive evatuation, a...2 number 
4, no social reinforcement = aggression was related 
negatively to performance. In other words, for the 
students high in aggression, periormance was im- 
paired under these conditions, Under condition 
number 3, negative reinforcement, aggression was 
related positively to attitude but unrelated to achieve- 
ment. But the relationship with performance, al- 
Uncugh positive, waz not significantly different from 
tero. 


Under the punitive conditions QMumber 3) high 
deference was related to lower altitude but was not 
related to achievement performance. 


Intracepion was negatively cc-related with speed 
and efficiency, and related to high atlilede under 
maximum social reinforcement, condition acmber 1. 


In another stud? by Parisi (1965) the basic para- 
digtn of the Frase study was replicated and an addi- 
thooal personality cest, the Cattell 16 FF, was giver. 
peor to learning. All materiais were administered 
in Nalian to Italian students in Italy. These results 


re) 
ERIC 


support those of Frase .nat negative evaluations 
were more |mportart that positive evaluations, Fur- 
thermore, positive relnforcement was more effe.- 
tlve than negative reinforcement in reducing the cor- 
relation between Intelligence and performance. Per- 
formance on the achievement test was related to 
deference, or lack of need for autonomy, when s0- 
cial relnforcement was used. When no social reln- 
forcement was used, performance was related to 
need for achievement and exibitionism. 


The data from these studles seem to show that 
it is possible to alter the quality and speed of the 
performance as well as the attitude of students by 
the way in which soclal reinforcement is used during 
the learning experience. They further suggest that 
it might be possible to achieve an optimum matching 
of personality characteristics with social reinforce- 
ment condiions for each individual student so that 
the general level of effectiveness of Instruction can 
be rai3zed by individualizing these contingencies, 


SUMMARY 


This paper summarizes a gereral model usd to 
design a computer-based lnstructionalsystem. This 
Kijographic contingency model defines classes of 
variables that are presumed to be imporiant in adap- 
tive instruction. It also specifies relationships be- 
tween those variables that characterize the learner 
beicre and after learning which can be uaed selec- 
Uvely to indlviduallze instruction. Included among 
the ‘before’ measures are krowledge, aptitude, 
and perfonality. The data indicate thatthe 'before' 
measures have different relationshipe with the ‘‘af- 
ter’? measures (e.g., amount learned and attitude) 
under different conditions of learning. These data 
support the model. 


The kinds of decisions that need to be made to 
individvallze irstruction were discussed and a set 
of research studics relating to them was descrited 
briefly. Relerance of the data to the model was In- 
dicated and it was pointed out that learning environ 
menta can be made more adaptive by wailing appro- 
priate matching of: (a) aptitude and sequence con- 
Lingencies; @) aptitude and encoding contingenc les; 
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TABLE 5 
CORRELATIONS BETWEEN INTELLIGENCE SCORES AND PERFORMANCE VARIABLES - 


(a) MIDPROGRAM TEST, (6) POSTTEST AND {c) ERRORS IN PROGRAM - UNDER FOUR DIFFERENT 
CONDITIONS OF SOCIAL REINFORCEMENT (PARISI, 1965) 


16 P. F. Factor B? Verbal Re2soning 
Intelllgence with with 
Group LM LP E LM LP E 
Condition) + -.07 33 -.22 +15 05 “24 
Condition2+ -.16 51° -.17 40 37 -31 
Condition 3 - 38 . 49° -. 44 . 40 .4ge¢ -, 23 
Conditlon 4 0 - 48° 42¢ -. 46* 474 . 46° -.18 
®The social relnforcement conditlons are coded as follows: Condition 1+ mean positive and negative social 
reinforcement; Corditlon 2+ is positive only; Condition 2- is negative only; and Condition 4 0 Is neither 
positive nor negative. 
bom is logic midprogram; LP is logic posttest; and E is errore. 
tp <.05 #*o< 01 
and (c) personality and evaluative feedhack contin- Crowder, N. A. Automatic tutoring by Intrinsic 
gencles, programming. in A. A. Lumadaine and A. 
Claser (Editors), Teaching machines and pro- 
The technological capabillty for accomplishing a grammed learning: a source book. Washing- 
high degree of indlvidualizatlon in instruction exists. ton, D. C.: National Education Assotlation, 
The problem now is to find the critical psychological 1960. Pp. 286-298. 
and educational dats which would make such a tech- 
nological capability an effective means of instruction. Detambel, M. H. and Solurow, L. M. Stimulus 
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from the Training Research Laboratory, Of - search and education. Pittsburgh: University 
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mma PART IV 


Gam Instructional Methods and Teacher Behaviors 


TEACHING METHODS, or the system of interactions which occur be- 
tween a teacher and students, have been the subject of many investigations in 
the last decades. In this Part, two recent paradigms for research on teaching are 
presented. N. lt. Gage points out that the global research on teacnin:: methods 
has not produced consistent, replicable 01 useable results. Therefore, a different 
aid more limited approach must be used, In ‘An Analytical Approach to Re- 
search on instructional Methods" he discusses micro-teaching, a technique which 
permits limited subsets of a comprehensive teaching system to be explored ana- 
lytically. Micro-teaching permits the gathering of data on a limited set of student- 
teacher interactions during a short span of time, less than a cluss period. From such 
research ‘micro criteria’ of effe.tiveness may be hypothesized and tested in terms 
of technical skills observable within the micro-feaching situation. 

Another analytical approach to research on teaching is proposed in 
the paradigm set forth by Ned A. Flanders in “Interaction Analysis and Inservice 
Training.” Flanders proposes a system of research in which a limited number of 
categories of stude.t-leacher interaction is used in observing classroom interac- 
tions. Interaction data are recorded of 3 second intervals. The resultant matrix of 
data allows rather effective analysis of the verbal interchange belween the teacher 
and the pupils. Interaction analysis is discussed in terms of ils use as a research 
tool and as a means of effecting behavioral changes in teachers, such as inserv- 
ice programs. 


mast An Analytical Approach to 
Kesearch on Instructional 


Methods 


INSTRUCTIONAL method constitutes 
one of the most important and promising but also 
the most frustrating of the areas of educational re- 
search and development. Compared with the areas 
of learning, sub/ect matter, instry. tional mater lals, 
and organization for Instruction, instructional meth- 
od appeals to the classroom teacher as closest to 
the heart of her problem. Itis all right for a teach- 
er to know about Jearning, to know his subject mat- 
ter, to have appropriate instructional materials, 
and to fit into a given organization for instruction. 
But what a teacher really warts to know is, ‘What 
should I do in the classroom?’ If you ask prospec- 
tlve teachers or teachers on the fob, ‘Where do 
you really want help?’ I think tha reply will deal 
with some aspect of Instructional methods. 


Unfortunately, the urgency of this demand has 
not been accompanied by corresponding success in 
meeting the demand. Research on teaching has 
ylelded relatively few solid and usable results, 
The stature of theory and research In other areas 
puts them well ahead of the study of teaching in the 
stcuggle for scientific maturity. 


Implicit in what Iam saylg is a basic distinc- 
tion between research on learning and regearch on 
teaching. The former deals vith ai] the conditions 
under which learning, or a change in behavior due 
to experience, takes place. And as J have already 
indlcated, the study of learning ls rela’Svely ma- 
ture, well established, with many volumes of sub- 
stantial literature to its credit. Research on teach- 
Ing, on the other hand, deals with a subset of the 
conditions under which Jearning occurs in one per- 
son, natnely, the conditions established by the 
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behaviors of another person, called the teacher. As 
our schools have developed during the past two or 
three millennia, we have always attempted to pro- 
mote and Improve the learning procesr through the 
intermediation of such another person. Until very 
recently, the assumption that teachers were helpful 
or even necessary for many Important kinds of learn- 
ing that society wanted to promote went unchallenged. 
Even today, the challenge of independent study or 
computer-assisted Instruction and other devices !s 
a mere whisper against the thunder of the assump- 
tion that teachers are necessary, that teachers are 
here to stay. My discussion of instructional methods 
is going to be based on that assumption. Itis the rel- 
atively neglected, undernourished, and underachieving 
subset of research on learning which I call research 
on teaching that I shall deal with hero. 


RESEARCH ON TEACHING 


The Stanford Center for Research and Deyelop- 
ment In Teaching is devoted to this problem area. 
In its conceptual framework, teaching, or the behav- 
iors and characterlstics of teachers, stands at the 
center. This domain contains variables that serve 
as both independent and dependent variables in the 
Center’s program. When tho teachers’ behaviors 
and characteristics serve as independent variables, 
and the pupils’ learning and behaviors serve as the 
dependent variables, then we have research on 
teacher effectiveness, or, more neutrally, vesearch 
on teacher effects. On the other hand, when teach- 
ers' behaviors and characteristics serve as the de- 
pendent variables, and teacher education programs 
and procedures serve as the independent varlables, 
then we have research on teacher education. Taking 
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both researchonteacher education andresearch on 
teacher effects as our domain, we have research 
on teaching, as [tis understovd inthe Stanford Cen- 
ter. My subject ls the Cernter’s program of re- 
search and develupment on instructional methods, 
and my procedure will be to work from the past to 
the present, from the general to the specific, and 
then to try fora look at where we are golng. When 
I get down to specifics, I shall be dealing primarlly 
wlth research in which I am involved, rather than 
all of the resc isch uncer way In our Center. 


PAST RESEARCH 


But first, let us look at where research on teach- 
ing has been, Asthe behavicral sciences go, it has 
aresgectably long history but a regrettably Inglor|- 
Ous one. Research on teaching has been gulng on 
almost as long ae research on learning. Some 
studies were t,.deé in the 1910’s and 1920's, and 
quite afew we-s made during the 1930’s. By the 
early 1950's, substantial revlews and bibllogra- 
phles of research on teaching began to appear. And 
durlng the last Uecade, the flow of research on 
teaching has indeed become significant. But the 
early years did not pay off in solid, replicable, 
meaningful results that had considerable theoreti- 
cal or practical value. Positiveand signifleant re- 
sults were scldom forthcoming, and they survived 
replication even less often. The research yl3lded 
many findings that did not make sense, that did not 
hang together in any meaningful way. 


Under these conditlons, as Kuhn (1962) has 
pointed out, research workers are impelled to re- 
examine their first principles, the paradigms by 
which they gulde their efforts. The mode} prob- 
lems and solutions of the community of researchers 
on teaching were accordingly subjected to more 
and more reappraisal. Licking the wounds inflicted 
by their negative results, researchers on teaching 
built up a modest literature of new conceptual 
frameworks, approaches, and paradigms for re- 
search on teaching. 


To illustrate, let me refer to one of the domi- 
nant paradigms that even today leads many discus- 
sions and research projects into the wilderness. 
This is the paradigm that says that what we need 
above all, before we can select and train better 
teachers, is the criterion of teacher effectiveners. 
Here is one example of that kind of approach: 


The lack of an adequate, concrete, objec- 
tive, universal criterion for teaching ability 
{s thus the prim.wy source of trouble forall 
who would measure teaching. One typical 
method of attack used {n rating scales Is to 
compile a list of broad general tralts suppos- 
edly desirable for teachers, with respect 
to which the rater passes judgement on each 
teacher. This amounts to an arbitrary def- 
inition of good teaching, which is subjec- 
tive and usually vague, but it does not nec- 
essarily lead to an identification of It. Only 
if the traits themselves can be rellably iden- 
tiffed can their possessor be identified as a 
“good teacher’? according to the definition 
laid down in the scale. Even when the scale 


is made Quite specific, relating not to gener- 
al traits but to concrete procedure, the furda- 
mental difflculty remains, that there i» ao 
external and generally accepted criterlon a~ 
gainst which the scale can be validated to 
establish the significance of its {tems 
(Walker, 1935, pp. x-xl). 


This kind of writing Implies that there !s some 
magic variable that applles to all of teaching, for 
all piplis, at all grade levels, in all subject mat- 
ters, and in all objectives, The phrase ‘‘the crl- 
terlon of teacher effectlveness’’ betokens a degree 
of generality that has seldom been found in any 
brarch of the behavioral sclences. It also reflects 
the mistaken notion that such a criterion, largely 
a matter of values, can be established on the basis 
of scientific method alone, 


RECENT RESEARCH 


The so-called criterion problem misied a whole 
generation of researc’.ers on teaching, embroiled 
them In endless and fruitless controversy, and lured 
them Into hopelessly ambitlous atterapts to predict 
teacher effectiveness over vast arrays and spans of 
outcomes, teacher behaviors, time intervals, and 
pupil charactzristics, alt on the basis of predictive 
varlables that had only the most tenuous theoretical 
justification in the first place. It ls little wonder 
that, when Berelson and Steiner (1964) dealt with the 
subject of teachers’ behavlors and cha:'acteristics 
in thelr inventory of scientific findings in the behav- 
foral sciences, they dismissed the ‘‘large number 
of studles’’ with the single dismal sentence that 
“there are no clear conclusions’’ (p. 44 :). 


If the global criterlon approach had proved to be 
sterile, what was the alternative? The answer was 
to take the same path that more mature sciences 
had already followed: If varlables at one level of 
phenomena do not exhibit lawfulnese, break thein 
down, Chemistry, physics, and blology had, ina 
sense, made progress through making finer and 
finer analyses of the phenomena and events they 
dealt with. Perhaps research on teaching would 
reach firm ground if it followed the same route. 


Apparently, a number of students of the problem 
had thls general Idea at about the same time. In 
1962, writing my chapter on paradigms for the 
Handbook of Research on Teaching, I coined the 
term, ‘‘micro-criteria" of effectiveness. As I 
sald in that chapter: 


-«» One solution within the ‘‘criterlon-of- 
effectiveness’’ approach may be the develop- 
ment of the notion of “micro- effectiveness, ’’ 
Rather than seek criteria for the over-all 
effectiveness of teachers In the many, varied 
facets of their roles, we may have better suc- 
cess with criteria @ effectiveness in amall, 
specifically defined aspects of the role... 
a Bufficient number of lawn applying to rela- 
tively pure aspects of the teacher's role, if 
such lawa could be developed, might even- 
tually be combined, .., to account for the 
actual behavior and effectlveness of teach- 
ers with pupils under genuine classroom con- 
ditlons’’ (Gage, 1983, p, 120). 
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A group of workers at Stanfora Universily, to 
which I was to move a few months later, took a sim- 
ilar view. In the Stanford program for tralning 
secomary-school teachers, Robert Bush, Dwight 
Alten, and their co-workers adopted wiat Se now 
known as the technical skills approach. Technicai 
skills are specific instructional techniquea and pro- 
cedures that a teacher may use in the classroom. 
They represent an analysis of the teaching process 
into relatively discrete components thit can be used 
{no different combinations ir: the continious flow of 
the teacher's performance. The specific set of 
technical skills adopted ir the teacher-education 
program at Stanford may be quite arguable. Indeed, 
the Ifst of skills has been revised a number cf tlmes 
over the past few years, What Is important is the 
anproach — the attempt to analyze teaching Into 
limited, well-defined, components thatcan be taught, 
paacticed, evaluated, predicted, controlled, and 
unde: stood in away that has proven to be altogether 
impossible for teaching vlewed inthe larger chunks 
that occur over a period of an hour, a day, a week, 
or a year. 


When analyzed-teaching, in tha form of techni- 
cal skills, is made the focus of wur concern, we 
find it possible to do fairly satisfying research 
both on teacher education and on teacher effects. 
The satisfaction comes from being able to measure 
or manipulate relevant independent variables, per- 
form true experiments, or make careful analyse3 
and measure relevant dependent variables. 


The idea of technical skills may be Illustrated 
by the terms used ina recent list of such skills, 
One was called ‘‘establishing set,’’ or the estab- 
lishment of cognitive rapport between pupils and 
teacher to obtain Immedlate involvement in the les- 
eon; one technique for inducing a positive set is the 
use of relevant analogies. A second technical skill 
ls that called ‘‘ertablishing appropriate frames of 
reference,’’ or points of view. A third technical 
skill {s that of ‘achieving closure,’’ or pulling to- 
gether major points, linking old and new knowledge, 
ut appropriate points within a teaching episode as 
well as at the end. A fourth technical skill is that 
of “using questions’ in such a way as to elicit the 
kinds of thought- processes and behaviors desired 
euch as simple recall, or concept formation, or 
evaluation, Other technical skills are those In“rec- 
ognizing and obtaining attending behavior, '’ ‘‘con- 
trol of participation,’’ ‘‘providing feedback, '’ “‘em- 
ploying rewards and punishments, ’’ and ‘‘setting a 
model, ’”’ 


MICRO- TEACHING 


These technical skills into which Important as- 
pects of the teaching Job have been analyzed are 
nut merely the subjects of lectures and discussions 
in the teacher education program. Rather, they 
form the basls for the intern’s practice teaching 
prior to his entrance into actual classrooms. This 
procedure, well known by now as “‘micro-teaching,’’ 
consists in getting the trainee to teach a scaled- 
down teaching exercise. Itls scaled down in terms 
of time because {t lasts only 56 to 10 minutes. It 1s 
scaled down in terms of class size, because he 
teaches a group of not more than five pupils, who 
are brought tn and paid to serve as pupils in the 


mlcro-teaching clinic. It is scaled down in terms 
of the trsk, since the tralnee attempts to perform 
only one of the technical skills In any single micre 
teaching session. The sessions are recorded on 
video tape, and tie trainee gets tosee and hear hlm- 
seif immediately after tie session. While he locks 
at and listens to himself, he receives criticisms and 
suggestions from supervisors trained tobe both per- 
ceptive and tactful. Then he ‘‘re-teaches’’ the same 
lesson to a new small group of pupils in an attempt 
to improve on his first performance of the specific 
technical skili that is hle concern In that session. 


Obviously, the general idea is subject to many 
variations. The size of the class can be manipu- 
lated; the number of trainees teaching a given group 
of children can be increased; the duratio.of the les- 
sons can be lengthened; and the nature of the teach- 
ing task can be made more complex 50 as to em- 
brace a group of technical skills in their real-life 
combinations, But the idea of analyzing teaching 
into technical skills remains the heart of the method 
and provide 3 ita power as a paradigm for research. 


The research on micro-teaching and technical 
skills in the Stanford teacher education program has 
taken the form of experiments In which various pro- 
cedures for feedback to the trainee are manipulated. 
Professors Dwight Allen and Frederick McDonald 
have organized a program of research on variables 
hypothesized to influence the learning of the techni- 
cal skills of teaching. Their independent varlables 
fall into three categories: practice varlables, feed- 
t-eck variables, and de:nonstration varlables. A 
practice variable may consist in micro-leaching 
versus teaching in an actual classroom. A feedback 
variable may be the positive or negative character 
of the feedback, or the medlatlon of the feedback by 
another person rather than the trainee himself, Fi- 
nally, a demonstration varia)le may take the form 
of symbollc demonstration, consisting of written or 
spoken words, or perceptual demonstratlon, consist- 
ing in elther live or video-taped portrayals of the 
desh-ed behavior; and each cf these can consist ei» 
ther of self- modeling or modeling by others, Other 
indep2ndent varlables have heen Identified, such as 
the timing of a reinforcement, the amount of prac- 
tice, and the amount of feeciback, 


This condensed descrip-ion of the Allen- McDonald 
research program can stffice to lllustrate the use of 
the analytic approach to research on teacher educa- 
tion. Their research takes the form of true experi- 
ments in which subjec’3 are randomly assigned to 
different values of the independent var’able. 


TECHNICAL SKILLS APPROACH - EXPLAINING 
ABILITY 


I should like to turn now to an example of the way 
in which the technical skills approach can be applied 
to the study of teacher effects. This research has 
dealt with a technical skill that I call ‘‘explatning, ”’ 
or the skill of engendering comprehension — usually 
orally, verbally, and extemporaneously - of some 
process, concept, or generalization, Explaining o¢- 
cursinall grade levels and subject matters, whether 
{t is a fifth-grade teacher explaining why the time in 
New York differs from that in San Francisco ora 
geologist explaining how the ice age may have been 


122 RESEARCH AND DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 


caused by yolcanic eruptions. Everyday observa- 
tlon tells us that some seople explain aptly, getting 
19 the heart of the matter with just the right termi- 
nology, examples, and organizatlon of Ideas. Other 
explainers, on the contrary, get us and themselves 
all rnixed up, use tering beyond our level of com- 
prehension, draw Inept analogies, and even einploy 
concepts and principles that cannot be understood 
wlths:t an understanding of the very thing that is be- 
ing explained. To some of us, it has seemed that 
expialning comes very Cloge to being th? Inner es- 
sence of instructlon, so that when a teac, er is at- 
tempting to explain proportionallty to his g‘ometry 
class or irony to his Engllsh class, he is behaving 
more purely asateacher than whenhe is attempting, 
say, to motivate, promote discussion, or mainta, 
disclpline. At any rate, we have made some stu3i.s 
of explaining abllity in the attempt to determine 
some of the characteristice of effective explanations. 


EXPLAINING ABILITY STUDY IN MICRO- 
TEACHING CLINIC 


The first study was made In the mlicro-teaching 
clinie at Stanford during the summer of 1865 by 
J.C, Fortune, R. F. Shutes, and N. L. Gage (i066). We 
attempted to determine the generality of explaining 
abllity, that {s, the degree to which the ability to 
explais one toplc was correlated with the abillty to 
explaln another topic, and the degree to which the 
abllity to explain a tople to one group of puplis on 
one occasion was Correlated with the abllity to ex- 
plain the same topic to another group of pupils on 
another eccaslon. We also were able to design the 
study 80 as to d2termine the degree to which there 
was generality over both pupils and topics, or the 
degree to which the ability to explain one topic to 
one group of pupil3 on one day correlated with the 
ability to explain another topic to another group of 
pupils or, another day. Because there were only 
sixty puplls to be shared In groups of five among 
approxlmately forty interns in the micro-teaching 
clinic, the design oecame quite complex in order to 
avold having any Intern teach the same toplc to the 
same group of pupils more than once and to avoid 
having the same group of pupils receive an explana- 
tion: of the same topic more than once. According- 
ly, the forty soclal studies interns - and we chose 
to work with the social studles interns only because 
there were more of them than any other kind of in- 
tern - were divided into five clusters of eight in- 
terns each, The lectures dealt with twenty different 
topics, each consisting of an ‘‘Atlantic Report’ from 
the Atlantic Monthly. The corretations that we ob- 
tained were thus medians of five correlations, each 
based c: four, six, six, six, and eight interns, re- 
spectively. 


The index of lecture effectiveness. or what I 
would lke to call the micro-criterlon ofteacher 
explaining ability, was the pupils’ mean score on a 
10-item test of their comprehension of the main 
Ideas of the lecture, which was presented by each 
intern in 15 minutes under somewhat standardized 
conditions. This mean score was adjusted for the 
mean ability cf the pupils in the given group as meas- 
ured by their s¢c:es on all of the other topics. 
Similarly, any given mean score was adjusted for 
the difficulty of the topic as measured by the mean 
score of all groups of pupils on that topic. Thus, 


the varlance of the adjusted mean posttest comfre- 
hension scor<s was altr lbutable not to the ability cf 
the pvyils or the difficulty of the topic but rather to 
the differences among the teachers. We then inves- 
tigated the question of the '.rious kinds of general- 
ity by determining the medlar. intercorrelations a- 
mong the varlous means. The upshot of this part of 
the study was that g¢..erality over topics was non- 
existent, and generallty »ver groups was about . 4. 
In other words, the inter..3 were moderately consist- 
ent In their abllity to explaln the same tople to dlf- 
ferent groups on different occasions, but they were 
not consistent in their abillty to explain d‘fferent 
toples. 


Yyhe stvdy dealt with the correlations becween ex~ 
pla ining effectiveness and the puplls’ rating of var- 
lous aspecis of the explanations. The puplls rated 
the Interns’ performance with resy ‘ct to twelve 
Items, such as clarity of alms, organization of the 
lesson, selection of material, and clarity of presen- 
tation. To us lt seemed that some of these dimen- 
sions should correlate more highly with explalning 
ability than others. In particular, we hoped that 
such discriminant validity would be manifest in the 
form of a higher correlatlonbetween the mean rating 
of the lecture for ‘clarity of presentation’ than for 
any of the other items of the Stenford Teacher Com- 
petence Appralsal Guide. Our hope was borne out; 
the correlation of the adjusted mean poettest com- 
prehension écores with pupils’ ratings of ‘‘clarlty of 
presentation” was .56, higher than tha’ vith any of 
the other rating scale items. ‘This resuis seems to 
us to support the valldicy of both the index of lecture 
effectiveness and the mean ratings by the pupils. 


EXPLAINING ABILITY STUDY IN PUBLIC SCHOOLS 


During the school year 1965-1966, I was able, In 
collaboration with Barak Rosenshine, to undertake 
a replication and extension of this study in the public 
schools (Rosenshine, 1963). Because there was no 
lack of studezts in tue high-school classes, taught 
be theirown teschers, we did not become involved in 
the complexities of design necessary in the micro- 
teaching clinic. To put it very briefly, we got forty 
eleventh-grade social studles teachers each to de- 
liver a 15-rainute lecture on an ‘‘Athantic Report’’ on 
Yugoslavia taken from the Atlantic Monthly. The 
teachers had been given the article several days in 
advance, and had been ‘old to prepare a lecture that 
would enable their puplls to answer a 10-item mult!- 
ple-choice test of comprehension of the article’s 
main Ideas. To galde them in preparing their iec- 
ture, they were given fiva of the multlple-choice 
qnéstions that would be asked, while the other {lve 
questions were withheld. After the 15-minute lec- 
ture, In which the teachers were permitted to use 
the blackbourd but no other aids, thelr students took 
the 10-item test. They also rated the tcacher’s lec- 
ture on‘items similar to those I have already de- 
scribed. Thenext day, the same teachers and classes 
did the same things, except that the subject matter 
was an ‘‘Atlantlc Report’’ on Thailand; again the 
teachers had been given five of the ten items asa 
gulde to the kind of lecture that they should prepare 
and had been told to focus on the explang’'on of the 
major ideas, concepts, and principles brought out in 
the article, which constituted the curriculum for this 
bit of teaching. On the third day, the classes heard 
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athilrd lecture, one that was the same for all 
classes, a tape recorded 15- minute lecture on Esrael, 
a verbatim reading of an ‘‘Atlantic Report, ’’ and 
then the puplls again took a 10-item test base on 
that article. 


The class mean on the Israel test was used to 
adjust the class means on Yugoslavia and Thailand 
for between-class ditferences In abllity. Our rea- 
soning was that the score on such a test of compre- 
henslon of a unlfoi'm lecture would be more useful 
{n controlllng relevant kinds of abillty than would 
the usual scholastic aptitude test. Theclass n:eans 
on Yugoslavia and Thailand were also adjusted for 
teacher differences in the content-relevance of the 
lecture, as determined by scoring the transcript of 
the lecture for relevance to the ten ltems on the 
comprehension test. We then assumed that the 
variance that stlli rernatned In the adjusted com- 
prehenslon test ineano of the classes would reflect 
differences between the teachers In what we were 
ccncerned with, namely, the Intellectual style and 
process of theteacher's lecture. In this study, the 
teacher’s adjusted effectiveness index on Yucosla- 
via correlated 47 with his effectiveness on Thalland; 
le., there was considerable generality of effective- 
ness over topics, even after student abllity and con- 
tent relevance had been partialed out. 


It should be noted that we were using the mlcro- 
teaching idea in this investigation. The teaching 
was restricted to just one aspect of the teacher’s 
role, namely, abllity to explain the current, social, 
political, and economic situation In another country, 
The curriculum was also scaled down. We also 
used another major feature of the mlcro-teaching 
clinic, the video tape reccrders which made it 
possible for us te study the teacher’s behavior, ver- 
bal and nonverbal, at jeisure. 


One major question was that of whether our crl- 
terlon, or micro-criterion, of teacher effectiveness 
in explaining, namely, the mean comprehension 
score of the pupils, adjusted for both mean pupll 
ablilty and content-relevance, contained variance 
that would be manifested in something about the 
lecture that was vislble or audible. In other words, 
was there some difference between good and poor 
explanations that was worth trylng to analyze? So 
v.e plcked two lectures on Yugoslavia that were ex- 
tremely high on our index of effectlveness and two 
that were extremely low. We had a group of eight 
judges read the article on Yugoslavia and take the 
comprehension test, and then watch and Ilsten to 
allfour of these lectures. Then the judges ranked 
the lectures in terms of perceived effectiveness in 
engendering comprehension as measured by the 10- 
item test. It turned out that the judges’ post-dic- 
tions wers quite significantly more accurate than 
could have been expected on the basis of chance, 
and we were accordingly reassured that our micre- 
criterion was indeed reflected in something that 
could be seen or heard in the lecture. 


But the major concern of this investigation was 
to determine the cognitlve and stylistic correlates 
of the lecture’s effectiveness, Yor thls purpose,we 
used extreme groups to minimize the labor of scoring 
a host of variables about which we had no great 
conviction. So the ten most eifectlva explanations 


on Yugoslavia were Identified and also the ten least 
effective. From these, we chose at random five of 
the most effectlve and ilve of the least effective. 
Then, groups of judges aid content analysts worked 
over the transcripts of the lectures, scoring and 
ratirg them ov a host of varlables. Some of these 
were sentence fragments, the average sentence 
length, the number of prepositional phrases per seu- 
tence, ands00n. Other variables dealt with the 
number of self-references by the teacher, or with 
various aspects of syntax, or Instructional set, fa- 
miliarization, uses of prevlous knowledge, mobilizing 
sets, attention focusing procedures, organizatlon, 
emphasis, amount cf repetitlon and redundancy, the 
number of words per minute, and s0 on. 


The varlables that discriminated between the flve 
best and the five worst lectures on Yugoslavia. were 
then tried cut on the other set of five best and five 
worst lectures on Yugoslavia to see If they still dis- 
criminated. Those that survived thi3 first cross- 
validation were then tried out on the best and worst 
lectures on Thailand, At the last accounting, two 
characteristics of the lectures had survived this 
kind of validation and cross-valldation procedure, 
These varinbles were what we are calling “‘explain- 
ing,'’ or the degree to which the teacher describes 
the how, why, or effect of something, and (he ‘‘rule- 
eg-rule’’ pattern, or the degree to which the teacher 
states a generalization, glves examples of it, and 
then summarizes a serlesof illustrations at ahigher 
level of generality than the illustratlons themselves. 
These two varlables not only seem to be valid in our 
data but also are rellably rated by independent judges. 
Nonetheless, these must not be consldered to be 
firmly established findings; they are merely examples 
of the kinds of conclusions to which research of this 
kind can lead. 


Currently, we are in the process of scoring all 
of the explanattons onall of the varlablesthat appear 
to hold any promise, and we will then undertake 
studles ofthe completecorrelatlon matrices invoiving 
not only the indices of explanation effectiveness, but 
also all of the characteristics of the explanations, 
and the ratings of the lectures by tiie pupils who 
heard them. Such a complete correlational study 
wlll throw light on the consistency from one lecture 
to another of the Indices of iecture effectiveness, and 
the styllstic characterisflcsofthe lectures, and also 
thelr Intercorrelations. 


What I have been describing is of course a corre- 
lat'onal study. Along with Its advantages In permit- 
ting the exploration of a wide varlety of possible cor- 
relates of explaining abillty as they occur under 
fairly normal conditions, it also has the disadvantage 
of making causal interpretations hazardous. For 
this reason, Studies of this kind ought lo proceed 
fairly x .pldly into experiments in which the different 
ways of explaining wlll b2 based, at least in part, on 
leads obtained from our correlational siudies. 


Such experimental research may lead toward 
quite novel methods of teaching that could never be 
developed on the basis of studiee of teaching the way 
teaching is. Stolurow (1965) has contrasted the ap- 
proach of ‘‘modeling the master teacher’’ with that 
of ‘‘mastering the teaching model.'’ The first ap- 
proach is that of studying the moat effective teachers 
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we can find In order to find out how they behave and 
what they ara Ilke 60 that we can attempt toproduce 
more teachers like them. Many research workers 
see little promise In this approach, They recom- 
mend that we undertake Instead to develop wholly 
new models of the teaching process designed for 
opt|mal effectiveness regardless of thelr similtarlty 
to the way teaching now goes on In thenormalclass- 
room, 


COMPUTER- ASSISTED PROGRAMMED 
INSTRUC TION 


The teaching model that many advocates of this 
approach have in mind Is that of programmed In- 
struction, particularly computer-assisted pre - 
geammed Instruction. As Suppes and Atkinson and 
vthers have descr ibed thls revolutionary undertaking 
in research and development on instruction, it holds 
out great promise Indecd. Before ton long. the 
annoylng problems In the hardware will have been 
rolved. After a somewhat lunger time, we may 
expect substantlal and well-valldated programmed 
curricular materials to have been developed in all 
the subject matters and grade levels. As one who 
has seen tho highly developed installations at the 
Brentwood School In East Palo Alto, Callfornia, 1 
must share the optimism of Suppes and Atkinson, 
aw other developers of computer-asstisted inetruc- 
tion. 


Their very success. or coming success, ralses 
problems for the kird of Instructional n.ethods with 
which we have been concerned in this paper. On 
superficlal examinatlon at least, certain major 
problems of ordinary classroom teaching seem to 
be clearly surmounted ty computer -aselsted instruc- 
tion. For example, the problem of the cognitive 
complexity in the teacher's task, of how the teacher 
can say Just the right thing at the right time to de- 
velop a conceyt or formulate a theory, is apparently 
well handted, at least in principle, by computer - 
assisted Instruction, Its program) can be worked 
out and trled out In meticulous dets.!1, well in ad- 
vance, at lelsure, by the most skilled curriculum 
experts fn the land, and then made avallable In all 
their subtlety and complexity to every teacher who 
uses the program. Another major problem in the 
ordinary classroom is thatof indlviduallzing instruc- 
tion. No matter how we group our pupils between 
Schools, within schools, or within classrooms, we 
stit! have the problem of adjusting the rate and di- 
rectlon of the teaching and learning process to the 
needs and abilitles of the individual pupil; here 
again, at least in principle, computer-assisted In- 
structlon seems at first glance to have the better 
of the live teacher. 


While pondering these problems, [ got some 
help from a restatement of the idea of Individualized 


instruction in a recent paper Ly Phillp Jackson (1966). 


Ke states it as follows: 

Irdividualizing Instructlor, in the educa- 
tor’s sense, means Injecting humor Into a 
lesson when a student seems to need it, and 
quickly becoming serlous when he is ready to 
settle down to work; It means thinking of ex- 
pee that are uniquely relevant to the 
student’s previous experience and offering 
them at just the vight tima; It means feeling 


concerned over whether or not a student is 
progressin;, and communtcating that corcern 
in a way that will be helpful; it means offering 
appropriate praise, not just because positive 
reinforcers strengthen response tendencies, 
but because the student’s performunce Is de- 
serving of human admiratlon; it means, In 
short, responding ag an Individual to an Indl- 
vidual, 


Individualization inthis sense is much more ‘tan 
allowing for Alfferences In speed of moving thr: ugh 
a program or providing different branches or ruvtes 
through the material, 


Jackson’s analysis of this «ind of Nmitatlon In 
computer- assisted instructlLn should be placed 
alongside of the indications by Suppes (1966) that 
tutoring and dialog, which are higher fevels of tn- 
struction than driil-practlce, are still well in the 
future, as capabllitles of computer-based Instruction, 
Hence, any fears about the rapid obsulescence °f 
Ilve teachers, even wherenarrowly defined cognitlve 
objectives are concerned, are quite unwarranted, 
That ls, there will etlll be a need for teachers to 
use the kinds of sechnicalskilts, Including explaining, 
with which the analytle approach belng developed at 
Stanford and elsewhere Is concerned. We shall have 
to continue to grapple with the problems of cognitlve 
complexity and indlvidualizatlon through the medium 
of the llve, human, teacher even tn the realm of the 
well-formulated cognitive objectives, And there will 
always be the indispensable role of teacher inassist- 
ing purlis In attalning various kinds of affective and 
soclal learnings in the classroom. 


Accordingly, group discussions, role playlng, 
teaching for divergent thinking, as well as the tech- 
nical skills I have already menttred, are all the 
subject of various research and development projects 
now Under way In the Stanford Center for Research 
and Development in Teaching. We are also looking 
at the way in which the organizatlonal context influ- 
ences the teacher’s choices among ways to teach. 
And, in one of cur projects, entitled “The Teacher 
in 1880,'? we are looking at the way in which new 
curriculum developments, televislon and other tech- 
nical aids, computer technology, and new organiza- 
tional schemes inthe schools will affect the teacher's 
role in the foreseeable future. 


CONCLUSION: A NEED FOR ANALYSIS 


In conclusion, let me refer again to what I gee as 
one basic new the me in the research and develop- 
ment in teaching that Is now under way at Stanfo-d 
and elsewhere, If it were necessary to sum It u,. in 
one Word, my word would be analysis, breaking down 
the complexities that have proven to be 80 unmanage- 
able when dealt with asa whole. We are no longer 
crippled by the notion that because there Is one word 
called ‘teaching,’ there ls one, single, over-all 
criterlon of effectiveness In teaching that will take 
essentially the same form wherever teaching occurs, 
Eventifnone of the analyses of teaching that we have 
how proves to be viable, they will not be replaced by 
the old global conceptually Impossible, complex 
variables that I see as the reason for the fruitless- 
ness of so much of research on teaching In the past. 


enti, 
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Instead, they will be reptaced by other analyses of 
teaching, perhaps even finer analyses, untll we get 
the sets of lawful relatlonships between varlables 
that will mark the emergence of a scientiic basls 
for the practice of teaching, I¢ may well be that a 
[5-.nlnute explanation of a 5- page magazine article 
le 3tlll too ?arge a unit of teaching behavior to yield 
valid, lawful knowledge. It may well be that the 
mean score ona 10-item test of comprehension, 
adjusted for student abllity and content relevance 
of the lecture, is still too large and complex a de- 
pendent variakte. Eut, compared with lhe massive, 
tangled, and unanalyzable units that have typically 
been studled in the past - in researchonthe lecture 
method, the discussion method, and class Size, for 
example - such units seem preclse and manageable 
Indeed. And eventually, of course, we shall have 
to put teaching back together agaln Into syntheses 
that are better than the teaching that goes on now. 
I think l¢ would be safe to say that there Is now some 
hope of our belrg able to develop a scientifically 
grounded set of answers to every teacher’s cen.ral 
question, ‘What should I do in the classroom?’ 
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was Interaction Analysis and 


Inservice Training 


WHAT IS INTERACTION ANALYSIS? 


INTERACTION analysis 1s a system 
for observing and coding the verbal interchange be- 
tween a veacher and his pupils. The assumption is 
made that teaching behavior and pup! responses are 
expressed primarily through the spoken word as a 
series of verbal events which occur one after an- 
other. These events are Identified, coded so as to 
preserve sequence, an? tabulated systematically in 
order to represent a sample of the spontaneous 
teacher influence. 


The most !mportant criterion which any codirg 
system must meet before it can be considered sat- 
{sfactory is that a tralned person car decode the 
data In order to reconstruct those aspects of the 
original behavior which were encoded, even though 
he was not present at the observation. A part of 
this article will describe inferences which can be 
made from a blind analysis of coded data. 


Interaction analysis has beenused to study spon- 
taneous teaching behavior and it hag also been used 
in projecta which attempt to help teachers modify 
thelr behavior. Inthe first instance there may be 
along pericd of time between observa‘ions and the 
analysis of the data. The data can be pumhed on 
IBM cards as they are collected over a period U 
several months, but a computer program to tabu- 
late and analyzs the data may be used only after all 
the observations have been completed. Onthe other 
hand, when inte, action analysis data are collected 
in order to providea teacher with information about 
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his own behavior as a part of preservice or {nserv- 
ice training, then it may be advantageous to code 
directly into adesired tabulation form so that inter- 
pretations canbe made at the earliest moment after 
the teaching episode !scompleted. Thisarticle will 
be more concerned with the procedures oi interac- 
tion analysis which can be used during preservice 
and inservice training, and less concerned with 
applications in more basic research projects, 


A possible goalof an Inservice training program 
might be to discover whether the spontaneous pat- 
terns of verbal communication which are observed 
are, or aren, consistent with the Intentions of 
the teacher. In such a program, the assumption Is 
made that modifying behavior in order to make It 
more consistent with intent will, in moet instances, 
result in animprovement. The model toward which 
behavior is modified Is created by the teacher at- 
tempting to change. 


An inservice training program can also be de- 
signed {n which all participating teachers attempt 
to make similar modifications, for example, devel- 
oping more sklil in making fulluse of the !deas which 
are expressed by pupile during classroom disuvwurse. 
Here the model could be justifiedfromthe results of 
research which made use of interaction analya's, 
but special care would be necessary in designing 
activities which would help teachers accept and 
understand the desirability of such medifications. 
In brief, the value orfentation would be that the qual- 
ity of classroom instruction is improved when the 
ideas expressed by pupils are more adequately rec- 
ognized, clarlfied, used in some step of a logical 
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analysis, ihus ,lving the pupils a more active part 
in the learning activities, 


In nearly all appitications of Interaction analysis 
it isdesirable tv collect other kinds of data such as 
pupll attitudes, pups! achievement, and perceptions 
of the teaching situation heid by the teacher and the 
pupils. These additional data permit the develop - 
ment of theory and explanation. 


The resources of such a program, as wlth oll in- 
service activities, require money Inorder to obtain 
time, epace, and assistance for those who are par- 
tleipating. A number of steps can be aniicipateu: 
(a) Prospective observers and participating teachers 
must be tralned to use the technique. This usually 
requires 6 to 12 hours under the directionofa quali- 
{fed observer. (b) Personal, self{-development 
gools mustbe clarified by the participating teachers, 
(c) Each teacher-observer team must set up com- 
parison situatlons Involving a planned change of be- 
navior and two or more observattons shevle be 
scheduled so that evidence cf change canbe assessed. 
(d) Plans to collect other cy p25 of information must 
be completed. (e) Soclal-skill tralning sessions, 
based on interaction analysis categories, are often 
helpful, esper tally when they are Incorporated in 
the observation training. Such training often helps 
teachers set personal goals for changing thelr be- 
havior. (f) Plans will be necessary to provide in- 
Centives for teachers and to maintain the momen- 
tum of the program), once it is started. (g) Care 
must he taken to insure freedom from threat, to 
make sure that the voluntary aspects of partic!pa- 
tion are genultie, and to avold superimposing che 
program as an excesslve demand on teachers who 
may already be too busy. 


OBSERVATION PROCEDURES AND 
MATRIX JHTERPRETE.TION 


Given ten categories, shown in Table 1, all ver- 
bal statements are Classifled at least once every 3 
seconds by a trained observer. The events are coded 
by using the arabic numbers from one to ten 
which are written down In sucha way as to preserve 
the original sequence. The data can then bé tabulated 
in a table of ten rows and ten columns which is 
called a matrix. 


Such 2 serles is entered into a matrix two ata 
time. The first number of each pair indicates the 
row of the matrix, the second the column. The 
first pair consists of the first two numbers. The 
eecond palr consists of the second md !ird numbers, 
and thus overlaps the first pair. All tallies enter 
the matrix as a serles of overlapping palra. 


With ony tally approximatel; every 3 seconds, 
there are one hundred tallies for § minutes, 1, 200 
tallies per hour; therefore, 20 minutes, or about 
four hundred tallies, provide a matrix with sufficient 
data for a number of inferences abvut verbal com- 
munication. 


In a sustained observation of a teacher covering 
six to eight 1-hovr visits, It 16 necessry to tabu- 
late separate matrices for different types of class- 
room activities. Each matrix should represent 
either asingle episode of clasa activity or any num- 
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ber of homogeneous eplsodes that are combined. 
We use five activity categories for junior high school 
academic subjects; ihey are: routine procedures, 
discussion of new materlal, discussion to evaluate 
student performance or products of learning, general 
discussion, and the supervision of seatwo.k or 
group activities. Ditferent activity categories may 
be useful for a self-contained e:¢mentary-school 
classroom. In any case, the purpose of tabulating 
the data in several different matrices, Instead of in 
just one total matrix, is delermined by the purposes 
of observation and the range of expecied classroom 
actlvities. 


In the case of the inservice tralnIng of teachers, 
data are tabulated Into separate matrices In such a 
way as not to mask the compar|son to be made. ‘To 
illustrate, suppose the comparlson is between two 
samples of teaching behavior, one before and one 
after several weeks of social skilltralning. Keep- 
ing the data in homogeneous actlvity matrices will 
help to avoidfalse conclusions. For example, a de- 
crezse, increase, or nochange in Certalncategories, 
when the two matrices are compared, may be due to 
the differences ir. the learning activities observed, 
rather than due to change In teaching behavior which 
resulied from inservice training. Grouping the data 
to represent homogeneous learning activities helps 
to avoid such confusion. 


A tabulated matrix divides into special areas for 
interpretations that are shown in Table 2. Particu- 
lar quesilons can be answered by comparing tallles 
within and between these areas. Here are some ex- 
amples. 


Areas A (1+2+3+4), B(5+6+7), C(8+2), and D(10) 
can be used to find the percent time the teacher 
talks, the pupils talk, and time spent in pauses, si- 
lence, and confusion. Comparisons between Areas 
A and B provide infor matlon about the relaive bal- 
ance between initiating and responding witiiin teach- 
er talk, Initkating teacher talk !s more d!rective. 
tends to support the use of teacher authority, and 
restricts pupltl participation. Responsive teacher 
talk is more indirect, lends to share authority, and 
expan’s pupil participation. 


Area E jis a block of nine cells that indleates the 
continued use of acceptance and praise, construc - 
tive reaciion to pupil feellng, and clarifying, accept- 
ing, and developing pupil ideas, as well as transi- 
tions among these three categorieswhile the teacher 
is talking. Inany inservice training programdevoted 
to Increasing the teacher’s sitenticn to ideas ex- 
pressed Ly pupils, before and after comparisons 
would require an analysis of these nine cells. In 
fect, an Inservice training program which attempted 
to teach more subtle differences in (he teacher’s 
reactlon to pupil ideas might require subdividing 
Category 3 in order to note the presence and ab- 
sence of various types of Category 3 statements. 
For example, 3-1 -- merely repests to show that 
the pupil ideas were heard; 3-2 ++ reacts to specif- 
ic pupll ideas, but only in termes of the teacher’s 
perceptions of these ideas; 3-3 -- reacts to specific 
pupil ideas, but reactions {ncorporate the percep- 
tions of one or more pupils; and 3-4 -- stimulatea 
reaction to a pupll’s ideas by asking questions so 
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TABLE 1 
CATEGORIES OF INTERAC. ION ANALYSIS 


Teacher Talk and Student lialk 


‘JEACHER TALK 


Response 


1. * Accepts feeling: accepts and clarifies the feeling tone ot the students In a non-threatening manner, 


Feelings may be positive or negative. Predicting or recalling feelings are included, 
2, Praises or encourages: praises or ercourages student action or behavior. Jokes that reiease ten- 
sion, but at the expense of another individual; nodding head, or saying ‘‘um hm?” or ‘‘go on’”’ are 


Inc!uded. 


3.* Accepts or uses Ideas of students: clarifying, building, or developing Ideas suggested by a student, 
As teacher brings more of his own ideas Into play, shift to category five. 
4,* Asks questions: asking a questlon about con‘ent or procedure with the intent that a student answer. 


Initlation 


“$4 Lecturing: giving facts or opinions about content or procedures; expressing his own Ideas, asking 


rhetorical questions, 


6.* Giving directione: directions, coiamands, or orders to which a student is expected to comply. 
71,* Criticlzing or justifylng authority: statements Intended to change student behavior from non-accept- 
able to acceptable pattern; bawling someone out; stattug why the teacher is doing what he !s doing; 


extreme self-refereice, 


STUDENT TALK 


Response 
. udent talk - response: talk by students In response to teacher, Teacher inaitlates the contact or 


Solicits student stafemeut, 


Initlatlon 


9,* Student talk - Initlatlon: talk by students which they initiate. If ‘‘calling on’’ student 18 only to in- 
dicate who may talk next, observer must decide whether student wanted totalk. If he did, use this 


category. 


10, * Silence or confusion: pauses, short perlods of silence and periods of confusion in which communl- 


cation can:ot be understood by the observer. 


————_———— 


*There is NO scale implied by these numbers. Each number je cluosificatory; it designates a particular kind 
of communlcatlon event. To write these numbers down during observation is to enumerate, not to judge a 


position on a scale. 


that other pupils react. In effect, Category 3 is ex- 
panded into four categories for a special purpose. 
This would result ir. a 13x 13 matrix instead of a 
10 x 19 matrix. 


Area F is a block of four cells that indicates the 
continued use of directions and criticism and transi- 
tlons between these twocategories, The two transi- 
tion celis are particularly reliable indicators of dis- 
clpline problems. Shifting from directions to eriti- 
clam {s tallied in ihe 6-7 cell, and indicates that 
expected cumpllance is Judged unsat(sfactory by the 
teacher. Shifting fromcriticlsm back to directions, 
the 7-6 cell, indicates a return to more directlons 
after criticism, 


Areas GO] and G2 are particularly interesting be- 
cause they Isolate the immediate responee of the 
teacher at the moment students stop talking. One 
aspect of teacher {lexiblilty can be dlecovered by 
comparing the balance of Indirect and direct state- 
ments shown in G) and Gg with those found In Areas 


Aandi B, The differencebetween supeificlal, short, 
perfunctory praise or clarification, and praise or 
clarification that is more carefully developed is 
eatily seen by comparing the tallies in Area Gy with 
those in E, perticularly the 2-2 and 3-3 cells. 


Area H Indicates the types of teacher state- 
ments that trigger student participation. Respons- 
es tothe teacher are found in column 8; state- 
menté initlated by the student in cclumn 9, As one 
might expect, there is usually a heavy loading of 
tallies in the 4-8cell, High frequencies in tals 
cell and the 8-4 cell, but not in the 8-8 cell, often 
Indicate rapld drill. 


Area I indicates sustained student partleipation., 
These may be lengthy statements by a few students, 
or etucsnt-to student communication. 


So-called ‘‘steady state’’ cells fall on the diago- 
nal from cell 1-1] to 10-10. Tallies here indicate 
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TABLE 2 


AREAS OF MATRIX ANALYSIS 


CLASSIFICA. | CATE- 
TION Go 


RESPORISE 


STUDENT IDTA 
ASKS QUESTIONS 


LECTURES 
INITIATION 
GIVES DIRECTIONS 


CRITICISM 
STUDENT RESPONSE 
STUDENT INITIATION 


SILENCE 


thal the speaker persists In a particular communi- 
catlon category for longer than 3 seconds. Ail 
other cells ae transition cells moving from one 
category to another. 


Oxilined lathe center of Table 9 by dazh Hines is 
the content crozs, The total number of tallics in 
this aret, Compared with talliea not Inthis area, 
giv2s a very Crude indikation of the content orienta- 
thon of Ihe class activity. 


In addition to making use of th? areas Just des- 
trived, the follo. tag procedure can be followed to 
inter peet 8 matrix. 


Firat, botate the single cell within the len towe 
and cowmns which Ass the highest frequency. The 
pair of eventa, represented by the cell, (s the mest 
trequemtly cccarring and can be wsed a8 & Atarling 
print ia reconstructing Uhe interaction. 


Secon’, from this highest veqeency cell, pow 
start forvacd or backward, in terms of sequence, 
to begin a sequence digtam. The row of any cell 
indkatea the most Ikely third erent, that is, the 
erent which fe moe likely to follow, given an crigi- 
nal pair ct events designed by the highest {reqoency 


“Content Cros. | 


+ 
' 
J 
| 
| 
| 


cell. The column, onthe other hand, indicates 
which event most prodably preceeded the pair of 
erents In question. The flow of events is properly 
repcesented when the eye scans the malrin in a 
clockwise rotation. Should the highest frequency 
fali into a transition cell, not & steady state cell, 
the row or colum of either nember in the patr can 
be studied to retrate or advance the sequence of 
events. 


An example of matrix interpretation WIL! be 
shown later in this article. Skill tn matrix Inter- 
pretation, howerer, !8 not likely to develop from 
reading this article, which serves only to propose 
guidelines. Foe that matier, skill tn observation 
cannot develop from reading about how It fe done. 
All aspects of Interactica analysis rejelre practice 
in order to develop skill. Ris the cpposie of a 
epectator sport. 


FEEDAACK ANS CONSALTANION 
WITH TEACHERS 


The pir pose of leedback is to provide a teacher 
With information sbovt his torbal statements which 
permits a compatioon wkA ame standard ce model 
of what should have happened. Withoet purposire 
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comparisons which are planned In advarce of the ob- 
servation, the reactions of the person receiving the 
information may be reduced to !cidental specula- 
tions or points of interest that h-; pen to be noticed. 


To be useful as a model or standard, one’s inten- 
tions must be specified in termsofl frequenclesto be 
feind in the cells of the matrix. Thus, if a teacher 
wishes to practice providing more extended praise, 
he will expect to find an increase in the 2-2 cell of 
the matrix, one situation compared to another. Ia 
teacher decides he would like to stimulate more pu- 
piltalk in which Ideas are initiated by pupils, he 
might study column A inthe matrix to gee what events 
trigger these pupil statements. In a program of in- 
service training in which all teachers attempt to in- 
Crease the utilization of Ideas expressed by pupils, 
attention will be directed to column § and row $ of 
the matrix, 


Most Inservice training programs can achieve 
some success inbringing selected concepts and value 
orientations to the attention of teachers, these are 
matters of awareness. Evidence !hai such awarenets 
has been implemented through vvert betavior re- 
quires anodjective assezsment of spontaneous teach- 
ing behavior. 


The assesament of the spontaneous behavior must 
be reasonably objective in order to be reliable, Un- 
fortunately, interaction analysis is not free of bias 
and error, peodably about one out ofevery ten classi- 
fications of an experienced observer is incorrect. 
Interaction analysis dala can be and probably are 
more objectiva, when dealt with in summary form, 
compared with most other procedures for making 
Judgments about spontaneous teaching behavior. 
Judgments about events which occur within time 
tegments of only a few seconds and which must be 
repeated agaln and agaln tend to become more constst- 
ent with practice. Furthermore, muting the presence 
or absence of a short event is not a procedure which 
lends itseit ag easily to distortion and bias. 


No matter how objective, reliable, and valid an 
assessmert procedure, the results will be distorted 
Wf the Sehavtor itself 15 distcrted. Unfortunately, 
merely antk ipating observation might cause non-re- 
Presentative behavior to appear, tot fo mention the 
observation experfence itself, Below are some pol- 
Keles and suggestions which we have found helpful 
in reducing the tendemy of a teacher to put on an 
ocl while being observed. 


First, an observer should be In the classroom 
oniy when invited by the teacher. 


Second, the lnvilation should be based on a plan 
ot Wyeiry which was deve'oped ty the leacher and 
observer prior to any classroom visits. Obdserva- 
Vion should ptodece irdormation which is relevant 
lo some peodlem or question which is conaklered 
important to both parlicipanta. Thus, a teacher 
parikc ipating in an inservice training progtan: which 
groposes tolmorove the way pupil ideas are handled 
during classroom discussion may de curious about 
this aspect of Interaction before and after training. 
Such a Question migh involve creating two similar 
lereon plans in chich a teacher would be confron ed 
with opportanities to react to pupil bdeas. One tes- 


son would be observed before training and the sec- 
ond lesson after training, The plan could be em- 
beltished to provide grealer insights by collecting 
additional dala. For example, predictions about 
Pupil perceptions, teacher perceptions, pupil atti- 
tudes and similar phenomena could be made, one 
lesson compared with the other. Then, instead of 
merely counting the incidence of constructive teacher 
reactions to Keas expressed by pupils, certain 
theorles about the consequences of suchteacher be- 
havior might be Investigated. 


Third, the status and power difference between 
the observer and the teacher should be a minimum. 
Another teacher who fs a best friend might make 
the most appropriate observer, providing skill in 
observation js present, 


Fourth, the conference to provide feedback should 
follow a logical plan of fiquiry. Alt the relevant 
data should be af hand and referred to In terms of 
questions to be answered and not In terms of idle 
curiosity. & often helps to have two or more ma- 
trices, since this facilitates the making of compart- 
sons ovt of which theoretical explanation grows, A 
single matrlx more often stimulates opinions sbout 
what is ‘‘good"’ and ‘'bad,'' illostrated by the ques- 
tion, ‘Do ycu think the lesson was satisfactory?" 
Such questions place the observer in an awkward 
Position, since he muslexp-ess areneral judgement. 
In this position he cannot be an €aual partner in tne 
inquiry process. On the other hard, hen ahypo'he- 
sis about behavior is being Investigated and profes- 
slonal competence of the teacher is net In the fore- 
fround, the anatysisof data is more systematic and 
unwanted defensive distractions are less likely to 
occur. 


Fifth, the entire procedure including planning, 
execution, and anatysis usually works more smooth- 
ly when the teacher, as vell asthe observer, has 
had approximately equal exper lence in observation. 
For example, setting up hypotheses, designing two 
comparable lesson plans, and knowing where lo look 
Ina matrix for the neoper information are phases 
of the exgerlence whic’ shoul te shared by two 
partners who are equally Competent. When the od- 
server js more experienced ard competent, the 
(ceeher defers and becomes the dependent member 
Of the team. Both memters of the teem should 
have had previous experienc® in both (caching and 
odservation, 


ALUSTRATIONS OF 
PRACTKAL PROCEOVRES 


For purposes of Itustration, let us assume thal 
the goal of Inservice training Is to increase the 
texcher’s skill In making use of ideas expressed by 
pupils. fn an article as short as this one, only four 
aspects of such an inecrvice tratning prograra elll 
be mentioned. First, some initial performance data 
ftorides a before training performance pattern for 
Which subsequent cbsei~aifon dala can be Compa; ed. 
Second, ekill training procedures canbe closely cor- 
related to observation procedures. Third, data ts 
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tabu 3 


OBSERVATION MATRIX 


Content Crom=70 6% 
Sreody Sore = OF % 


10 =077 
1D =18 
ae 


addition to interaction analysis are helpful In de¢eld- 
ing whether or not a Change in behavior js an inv- 
provement. And fourth, more advanced training de- 
signs and more co-uplex data collectica procedures 
will be necessary to push progress beyond the Ini- 
(ial results. Each of these four topics will be dis- 
cussed In turn. 


INITIAL PERFORMANCE DATA 


initial performance data might be in the form of 
a shor! observation during a Class discussion. Table 
3 shows a matrix of a teacher which will row be in- 
ter preted to show how the observer and teacher make 
af Initial diagnocis before lraining. The eame data, 
cf course, can serve as a before training standard 
in order to determine whether change has occurred. 


Since the total tallies equals 380, one can esti- 
mate that the matrix represents about 79 minetes of 
Interaction (100 tallies = 5 minutes, 20 tallies = 1 
minute). 


A number of percentages and other ratios, which 
help to form an initial pkture, can be found al the 
dboitom rows of Table $. For example, the tcacher 
talked 58.9 percent, the pupils 39.2 percent, and 
silence and confesion wes 2.1 percent. The teacher 
was falrly directive, that Is he inktated more than 
be resproded, as shown ty an U/D « 0. 17 (divide all 


tallies in categories 1+ 2434+ 4 by 5+ 6% 7 to ob- 
tain this rallo), The highest ceil frequencies are 
found tn the steady state diagonal cells, such as the 
5-5, the 8-8, and the 0-9celis. This suggests that 
the teather and puplis were able to conlinue a partl- 
cular mode of ecpression once lt started. Higher 
frequencies in these steady state cells indicate that 
the tempo of exchange was slower, for example, than 
might occur fn a drill perlod, All silences were 3 
seconds or less (note no tallies In the 10-10 cell) and 
most pauses followed teacher questions (N = § In the 
4-10 cell: ard teacher lecture (N = 3 in the 5-10 cell) 
rather than pupil statements. In six of these eight 
transitions, It was the teacher who broke the pause 
by talking (note that N = Lin the 10-8 and 10-6 cells). 
Ths analysis of silence supports the Interpretation 
that the teacher tended to initlate and did not permit 
@ pupil more than 3 seconds to respond. 


The matrix is sometimes more easily understood 
when itis translated into a flow pattern 1’ strated in 
Figure }. In thisdiagram the most frequently occur- 
ring steady state cells are shown as rectangles and 
the size of the rectangle indicates the relative fre- 
quency of the pair. Transitions among these cells 
are indicated by arrows and the thickness of the 
arrow {s roughly proportional to the frequency of 
these transitions. Anyone cin learn to draw such 
a patlernflow dlagramfromatabulated matrix. Be- 
gin withthe highest frequency Cell, in this case the 
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5-5 cell with eighty tallies. Proceed across the 
same row lo {Ind out the ne:.t most likely occurrlog 
events and inspect columns to identify the most 
Nkely preceding events. The arrows in Table 3 il- 
lustrate the clockwise direction of the flow. Thus 
In both the matrix and In Flgure 1, begin with the 
8-8 cell, sustained lecturing. The next most likely 
event is that the teacher will ask a questlor. Next, 
pupila are moat likely to respond to this question, 
see Category 8. There are two events of almost 
equal probabiilty following pupll response talk, one 
Is thatthe teacher will ask another question and the 
other isthatthe teacher will lecture. Thefourtran- 
aitiona shown by the heavy arrows in Figure | ac- 
count for most of the tnteraction: these are, §-4, 
4-8, 8-4, and 8-5, Other transitions do occur, but 
the tranaitions just tleted and their assoc lated steady 
state Cells account for 285 telllea or about 75 per- 
cent of the enlire observation. 


Many things could be said about this patlern of 
interaction, but by far the moat Cerlain Inference 
{a that in the event that this teacher increased his 
use of category 3, it could be clearly seen in the 
matrix. The use of category 3, especially the 3-3 
cell, Is below average for a classroom teacher. 
After training along these lines a second matrix and 
flow pattern diagram could be made as & compari- 
son with this initial performance. 


SPECIFIC SOCIAL SKILL TRAINING EXERCISES 


Specific social skill training exercises can be 
conducted which are cwosely correlated with inter- 
action analysis. A training skill exercise might in- 
volve three or four people who take turne providing 
certain patterns of verbal statements while respond- 
Ing spontaneously to the statements of others in 
the group. The person being trained Is designated 
as the actor, one other per sor. is the observer, and 
the rest are reactors or foils who provide spontane- 
ity. Different assignments are given to the actor 
which he then carriea out by interacting with his 
foils. The observer keeps a record of the communi 
cathon by, coding within the ten categories. The 
assignment can be given in terms of the categories, 
for example, the acter is asked to praduce a 4-8-4- 
8-4-8-4-8, ete,, sequence. Anactor might be asked 
to choose atopic and produce any sequence which is 
relevant toteaching and Is related tothe goals of the 
training. 


The activity of a training exercise follows a mod- 
el in which an actor attempls a particular pattern, 
his folls nrovide a spontaneous setting, and the ob- 
server keeps acoded recordof what happens. Some 
training epleodes may last only afew minutes, others 
are longer. Eacheplaode ts followed by a diac uss ton 
of the perfor mance and ways thal itcanbe Improved. 
While this kind of activity can easily degenerate into 
supertictal play acting, especially when first attempt- 
ed, & Ie also (rwe that serioua and Interested par- 
ticipanta can ese thia technique to practice produc ing 
certain patterns of deharvior ender increasing diffi- 
cek circumstances and make progress in the self 
control of spontaneous behavior. 


Leaning how to make fell ese of the ideas ex: 
Pressed by pupils is a goal to which spontaneous 


shill training exercises can easily be adapted. It is 
possible to gain practice in listening carefully, in 

listing tieas expreased by another person, in aum- 
marlzlng ideas which have just been expressed, in 

butiding questlons on ideas expressed by olhers, and 
to teach pupils to initlate thelrown steps in problem 

solving by showing a pupll how his ideas are related 
to @ problem. 


Skill practice sessions become more realistic 
when they are closely related to classroom practice 
sessions. After one or two initlal observations an 
observer and teacher may discuss the relationships 
between the teacher's intention and the patterns 
which appear on several matrices. Skill practice 
sessions are then designed to emphasize a personal 
goal of the teacher based on discrepancies revealed 
by the matrix. If the training ac''vitles are custom 
built to the needs of the teacher, and if he sees them 
ae relevant to his own professional development, 
then he is more likely to approach the training ses: 
sions with seriovs intent and & sense of cttimism 
concerning personal development. ft aleo helps 
when Classruom patierns begin to change lia de- 
sired direction a8 &@ result of skill practice sessions. 


Usually, the assignments of actor, foit, and ob- 
server are rated during skill practite sessions. 
Inthis way a teacher not only becomes familiar with 
the coding system of Interaction analysis, he alao 
obtains soine degree of observer proficiemy. He 
also learns to accept and developthe perceptions that 
others have of his behavior. 


The primary purpose of these training episodes 
{8 to practice producing certain patterns of etate- 
ments, totranslate concep's abou: teaching Into spon- 
taneous behavior patterns, to learn how ‘0 assess 
such patterns, and to discuss how these various pat- 
terns appear in classroom teaching. Many varla- 
thons oF Lraining exercises can be directed toward 
these goals making them useful for inservice training. 


DEQDiNG WHEN A CHANGE 5S AN IMPROVEMENT 


DecHing when a change ta an improvement usval- 
ly requires data in additton to Interaction analysis. 
For example, merely giving ateacher Ur structions 
to ''go in there and predute more threes,’’ much 
Ike a football coach, Is quite Itkely to increase the 
incidence of category three. This change may take 
place, howerer, without any insight into the teaching 
procesa and may possibly be seen as etiher inappro- 
priate or not realistic by the pupils. 


Ulliaing the eas expressed by pupils during 
classroom discourse involves several pedagegk ally 
Bound principles. One such principle is that this 
kind of teacher behavior attraviates the perception 
among pupila that each pupil 's free to express his 
Kdeas. Simple peper and pencil reaction sheets, to 
be fil!ed out by pupils old enough to read and write, 
can be used to assess pupil perceptions immediately 
following a practite session In which the teacher 
trles to secept and clarity pupil ideas. When both 
the observer's records and the pupil’a average er- 
Cestions froma paper and pencil Instrument indie ate 
gteater expresalor and ase of pupil dca, then the 
additional evidence provides greater contidence 
that the change Is an improvement. 
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Another pedagogical principle is that a pupil 
learns tocluster ijoeas because they are sim 
tar and then abstract the cluster with an approvri- 
ate label (hrough directed practice in expressing his 
ideas. A second observer can keep an Inventory “f 
separate ideas expressed by pupils, he can note In- 
stances In which the pupils, instead of the teacher, 
noticed aciluster, andtinally, he can record wheth- 
er the teacher or the pupils supplied an approprl- 
ate label to a givencluster. Thla additlonal evi- 
dence also helps to show whether a change Inteach- 
er behavior {8, or Is not, an impravement. 


PUSHING TRAINING BEYOND SUPERFICIAL 
CHANGE 


Pushing tralning beyond superficial change usu- 
ally requirea special category systema of Inter- 
actlon analysis. For example, the division of cate- 
gory 3, mentioned earlier, can provide a record of 
different kinds of teacher reactions to the ideas ex- 
pressed by pupils. A similar cxpansion of catego- 
ries 6 and 9 will show varlations In the different 
kinds of pupil statements. Often the expaneion of 
teacher talk categories can provide more iniricste 
and dificult social akill training assignmenta. 
Working back and forth between more elaborate 
category systems and more complex spontaneous 
@oclal skill training assignments helps a teacher 
understand peinciplea of pedagogy in terms of dis 
own tehavior (Unleas a teacher can act out his in- 
sights abou, teachiig, these insighs are of little 
ate for the Improvement of instruction. 


SUMMARY 


The use of interactlon arstysla in an Inservice 
training program places an emphasis on the analy- 
als of spontaneous verbal behavior. This emphaals 
helps to tranalite ideas about teaching into class- 
room application, 


For those who would like to try classifying ver- 
bal atatements, but are inexperienced, a rumber of 
referencea are listed at the endof thisarticle which 
include auggeations for beginning. 
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amemen PART V 


wes The Current Scone 


THE CURRENT scene in educational research and development is one 
of rapid and unprecedented change brought about largely by the advent of Fed- 
eral funding. In the first paper In Part V, R. Louis Bright and Hendrik D. Gideonse 
trace tho development of these changes with reference to involvement of the 
Federal government starting with the 1954 legislation. They cite the national need 
for the results of educat'onal research and development as the basis for the de- 
cision of the government to provide grant dollars for developmental projects and 
the design of the necessary strategies to implement programs of research and 
development. The evolving strategias of research and development designed to 
improve education wie delineated by the authors and include 1) curriculum devel- 
opment, 2) research and development centers, 3) the educational research infor- 
mation centers, 4) a program for training educational researchers, and 5) a sys- 
tem of autonomous educational laboratories. These strategies have developed rap- 
idly and promise to provide the basis for much of the future growth of educa- 
tional -esearch and development. 

The costs of educational research and development have grown from 
the original 1.7 million oppropriated in 1957 to the present level of approxi- 
mately 200 million. This represents less than one-half of one percent of the total 
arnount expended for education by all phases cf our society, a figure which is far 
under the standards for research and development investments in most mojor in- 
dustries. Clearly additional growth con be anticipated. The authors of this paper 
propose additiona! major expenditures in research and developmen! amounting 
to some billion dollars annually which would represent the still modest figure of 
opproximately 2.2 percent of the total expenditures for education. 

This continued growth of research and development in education, 
which is almost exponential, calls for careful and systematic planning. In an- 
swer to this need the Bureau of Research, U. §. Office of Education, has pro- 
posed the establishment of Educational Policy Centers to conduct studies for estab- 
lishing the means and directions of educational research and development 5, 10, 
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20, and 30 years hence. The rationale of these policy centers is discussed by Bright 
and Gideonve. 


The rationale and focus of a specific Research and Development Cen- 
ter is presented by Herbert J. Klausmeier, The Director of the Wisconsin Research 
and Development Center for Cognitive Learning. The Research and Development 
Center concept was proposed by the U, S. Office of Education in an effor! to better 
coordinate research and development activities and to establish programatic re- 
search and development in specific areas related to the educational process. The 
Wisconsin (-nter is doscribed in terms of eigtt components of operation: (1) prob- 
lem area, (2) ovlcomes sought, (3) research and development program and 
strategy, (4) disseinination and adoption program and strotegy, (5) staff, (6) 
admilsiration and management, {7) locus of operation, and (8) source of sta- 
bility of funding. Klausmeier points out that the programatic activities of the Wis- 
consin Center which have been brought sharply into focus now include 1) proc- 
esses and conditions of learning, 2) processes and programs of instruction, 3) 
facilitated environments. Other programs deol with disseminotion, training activi- 
ties, and technical support. Such a center concept brings to bear on problems of 
education the diverse talents of the interdisciplinary staff available at a major 
American university. 


Most new and complex activities are more readily understoc.d if 
represented in a model Idealizing their essential components and operations. The 
total research and development effort in education is no exception, The model 
proposed by Hendrik Gideonse in the final paper recognizes the Independent 
characteristics of the research act and the development act. In o prior model 
proposed by Guba and Clark the research activity precedes and feeds results 
into the development activity which in turn provides materiols ond programs for 
adoption. However, Gideonse proposes ao model which emphasizes the nonline- 
arity of the research and development complex. He states, My purpose in de- 
veloping an alternative model it to create a heuristic which illustrates the essen- 
tial differences between research and devefopment activities and show how the 
two are—or can be—related to one another and fo the operating educational 
system.” 


The model proposed emphasizes the quite diteront objectives and 
outputs of the research and development activities. Research is characterized es 
an activity begun with specific outcomes not being known. Contrasted to this Is 
the development activity which is begun with the objective known or established 
at the onset. In the model proposed the dynamics of initiation of research and 
development activities are quite different, as are the outcomes or products. Re- 
search may be initiated for its own sake and pursued solely for the knowledge 
which if produces. Whereas development activities are initioted in response to a 
specific need; the specifications for Ihe product can frequently be defined before 
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the onset of the development activity. However, even though the utilization of 
the research product is not predicted or predictable there rests on the researcher 
the obligation to present results in such a way so as to allow transfer to other 
research or development projects. In the model proposed by Gideonse the out- 
put function of the various activities is crucial. Such a model allows those con- 
cerned with planning research ond development activities to more clearly see the 
essential characteristics of these activities. 

The authors of this section describe the current scene and provide o 
glimpse of the future of educational research and development. The growth of 
the present research and development investment may indeed be a prologue to 
the future, 


mmm Research and Development 
Strategies: The Current Scene 


cummee R, Louis Bright end Hendrik D. Gideonse 


IT 18 MOST stimutaling to partici- 
pate in a fleid which haa generated as much excite- 
ment as educational reaearch has in recent months. 
Controversy, dlacussion, and debate are very much 
the order of the day; the gradual growth of contacts 
with new and informative sources of data, and of 
faith in the research effort are developments full of 
promise for the future. 


In agreeing to prepare this paper, we explicitly 
accept the notton that it makes sense to consWer 
strategt2s of research and derelopme ¥ for Improving 
education. At the same time we do not make any 
claim to producing ansthing more than lentatire 
steps in the direction of more adequately dezined 
sirategiea for achieving mutually agreed upon obdjec- 
lives. For a variety of reasons which we will at- 
tempt to spell out in this paper, we have begun the 
process cf developing and arpptying mote expt 
strategies to the research and derelopment procesa. 
These strategtea are neither rigid nor lightly held. 
Some aotlons of what we are about and why are 
Clearly necessary; act to have them fa to default a 
major responsibility. In thia paper we Ury to spell 
ovt both the general outlines of the etrategies we 
are parsaing and the protederes by whch we hope 
te Continually modify the spec itic swbstance Implicit 
inthose slralegien and the actwal strategies them- 
selves. 


The improrement of American education depends 
wpon the systematic investigation of the process and 
the necessary Conditions for learning, the derelop- 
mert of [nstrectional oectives, strategies, sad 
materials based on the knowlaige educators and 
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othera accumulate about the learning procesa, and 
finally on the implementation of those strategies and 
the use of those materlala tn Instructional settings 
across the country. We take thia as a fundamental 
article of faith, dut It fa a faith which has been sub- 
stantlated orer And over again in all fields of tuman 
endeavor whether they relate lo space, health, poverty, 
industry or education. To claim, however, that sig- 
nificant and continuing advances inthe process of 
education depend upon research and development Is 
only (2 barest of opening statements. A perspective 
and the setting need first to be sketched tn, and then 
a full exploration of the ramifications of that article 
of faith needa to be conducted. 


SETTING THE PERSPECIIVE 


Ang consideratton of the role of research and de- 
velopment In American edutalion necessarily relates 
to the nature of the existing “system”? through which 
we have institutionalized edacation If our pottety. 
Wh legal teapons ibility for education inthis coontry 
vested inthe states and operational responsability for 
echoots largely delegated to some 25,000 local edu- 
cational agercies authorized by the states, the tole 
of the Federal government hat lergely been confined 
to providing apectfied calegoe kal financial support. 


These different kerels of responsidility are com- 
plicated by another featere of American education. 
Not reany of the diveree institutions and agencies 
which serre education in this society are well-coor- 
étnated or formally related lo one another. When 
we use the word '‘system’’ as applied to American 
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education, we are being generous. What we have is 
ade facto system which serves the broad needs of 
the soclety well, but perhaps not as well as it might 
if It were generously laced with efficient communi: 
cation channels designed to make it an integrated, 
functionally related entity of many parts and many 
purposes, 


From the polnt of view of the general Imrrove- 
ment of education, it makes more sense to talk of 
the educational system a8 composed of stasses of 
Inatitutions and agencies, Each class embraces 
organizations which perform similar functions and 
which, if there were an organized system, would 
be expected to fulllll a particular role, Thus, the 
Classes of Institutions Include the three tevels of 
responsibility for education = focal, state, and 
federal. Idey include professional associations 
and Institutions for training teachers. They Include 
the Industries which supply materisis and equip- 
meattothe schools. They include universities and 
Institutes under whose segis research on eiucation 
and learning is performed, The existing ‘‘system," 
in other words, is largely a collection of nearly un- 
relsted sub-systems or institutions representative 
of sub-systems. This feature is of no small im- 
portance In devising strategies for the general im- 
provement of the whole. 


A NATIONWIDE NEED FOR ENUCATIONAI. 
RESEARCH AND DEVELOPMENT 


The nationwide nature of the need for educa- 
tlonsl research and development Is becoming In- 
creasingly apparent. Schools, districts, state 
education agencies, private institulions, colleges, 
and universities all have major needs relsting to 
the improved fulfillment of their Instructional re- 
sponsibtlities, While individual Institutions and a- 
gencles differ, many Lf not a majority of the prob- 
leme which confront them are similar, Serious 
@"" sttons of economics of scale have been answered 
n effect by (© relstively srali amounts of money 
whith have Ucen devoted to educstional resesrch at 
the local level, We have seen for decades an eatire- 
ly reasonable re sgonse on the part of local and etate 
agencies with respect to the funding @f major re- 
eearch and development efforts, While they have no 
Gout been awsre that sophisticated, well- conceived 
research pecgrams woukd benefit not only them- 
selves but aleo many others az well, very few hare 
felt that they thepiselres could aasume che financ!s] 
and human burden of mosMing large-scale research 
frograms. R would make vastly more sense Hf 
the acteal cost of generating those lindinga and 
matetials were amortized more proportion: 
ately across all the potential deneficlar- 
fes. 


The method for teaching mathematica, for example, 
is mot likely to be moth different foe similar chil- 
dren in Maine and Arizona On the other hand, there 
may be significant déferences in instrection in 
wnathe matics withia a state fo> children having dii- 
ferent pocto-economit chasscteristics, learning 
styles, or motivational problems, R woeld be a 
philanthro,ce district of state that felt itcoeld moent 
the requisite research and development projects to 
serve allthe immediate kcal needs when some other 
mechanioms could be deteloped which would 


distribute the cost more fairly in return for the mu- 
tual benefits that would be derived. 


THE EMPLOYMENT OF NATIONAL RESOURCES 


ile resources for conducting educational research 
and development, though not as limited as some 
people would have us belleve, are in fact unequally 
distributed across the country, No necessary Con- 
Cluatons with respect to conilnuing patterns of sup- 
porting educational research can be drawn from that 
fact, but a consideration of it Is certainly one of the 
retevant contextual matters for the development of 
research and development strategies. The natlon- 
wide characler of the need for research and the un- 
equal distribution of the human resources for re- 
search reinforce one aindher. They highligh the 
breadth of the problem, In “ther words, 80 long as 
human resources are unequally distributed, the di- 
rect or implicit coordination of them lo serve re- 
search and educational needs of high priurity will 
conatitute cone of the major background considerstions 
in research sirategies. 


FINANCIAL RESOURCES 


Certainly one of the more important matters 
lendir.g perspective to research and development 
(R and D) etrategies for Improving education ta the 
Svalladility of financing. The resources are himited, 
Money avallable from sll sources for R and D In 
education has never exceeded | percent of the totsi 
annual expenditures on education in the nation as a 
whole. Estimated expenditurea for this fiscal year 
for all levels of formal! education are $48 8 billicn.t 
By contrast the funds svailable at the Federal level 
for educational research and development are some- 
where between $200- 220 million. * Simple arithme- 
1i¢ reveals that this amount constitutes leas than half 
of L percent of the total annual expenditure on educa- 
{lcn, We do not by any means take that as ''a given 
for the future, but it is most assuredly an Iriportant 
element in developing perspective on the prodlem of 
research strategies for the present. 


THE DISTINCTION BETWEEN "RESEARCH" AND 
“IMPROVEMENT"’ 


A final element for consideration In this context 
ts our conviction that R and D tn education and 
the change peccets In educst'w are two very different 
fanctlons or processes whith raust, however, be 
related intimately, sensitively, and Inmegrally to one 
anther. The research and derelopment process pro- 
dutes the substance of Improrement. ft yields the 
knowledge shout the learning process and the sotisl 
setting for learning and ecastion, and encourages 
the tefinement of objectives and the development of 
materials and instran tional processes which Incorpo- 
rate that knowledge into Improved educational prac- 
theea, 


The implementation of [hose practices in the 
achool systems across the nation - the differential 
accomodation of different Institetions and agencies 
to the new roles and expectations created by the 
Improvements - however, Is avery different tind 
of prodlem and requires strategies and tac’es com- 
mengerale to the task as H is revealed. The differ- 
ences Belween the two processes and the eniqve 


RESEARCH AND DEVELOPMENT STRATEGIES: THE CURRENT SCENE 139 


characteristics of each may very well shape signifl- 
cantly the strstegles adopted for one or the other. 
The functlonal demands of educational research and 
development, for example, place certain constraints 
on the process of impleanentation. Similarly, the 
extgencies of the process of irplementation may 
impinge upon the strategies for R and D which may 
be avopted. 


RESEARCH, DEVELOPMENT, AND THE PROCESS 
OF [IMPLEMENTATION 


Recent poticy-level discussions of educational 
research and development within agencies respon- 
alble for restarch funds, between such agencies 
ard thelr constituencies, andwithinthe researchcom- 
municy itself, have made it clear that there is far 
from unanimous agreement on the definition of the 
terma commonly applied to research and develop- 
ment. For thie reason, we belleve it would be 
helpful to establish how we are now using various 
terms = not to develop for all time a thesaurus 88 
applied to the research process, bul rather to clar- 
ify our concepts and Interpretations, 


The research and develcpment process tnvolves 
all those activilies designed to produce knowledge 
rdout the learnirg process (research, for examnie, 
designed to improve learning theory or to improve 
our understanding of the fundamental chemical, bio- 
logical, and neurological processes underlying 
learning). It Includes other kinds of activities de- 
voted to the social context of learning (for example, 
the classroom or schoo! as > social system, or the 
relationship atuong non-tnstructional factors such 
as motivation of peers, socio-economic status, edu- 
cational level of the home andthe direct Instructicnal 
{nerventions of the school such as ¢curritulum, in- 
etructional methodology, facilities and 80 on). ft 
inclades atudivs pertalning to the organization and 
admintatra.ton of the Instructional enter pr ire, 


Research ard develupment else Includes t ie de- 
relopment of new practices, materials, and proc- 
esses based on the knowledge newly created in the 
Other kinds of studies. This involves Identification 
of the specific Improvement desired and then the 
systematle engineering of the improrement, using 
allthe infor mation derived frombasit research that 
ig relevant. 


A third part o@ the peecess, closely related to 
development, is the demonstration of the feasibility 
a! the nez materials, peccesses, or organizational 
forms In other than the hothouse setting of the de- 
relopment laboratory. 


Finalty, a fourth element inthe R and D process is 
the systematic dissemination of Information relating 
toallthe different stages. tnformation about research 
projects completed and underway is eseential to the 
baste researcher, The educational derelo,er also 
needs to know the latest findings about learning if he 
Is to be able to Incotporste them in his work. Re- 
searchers and educators in the schools need to know 
whal the development people are wpta On the 
other hand, the kinds of prodlems encountered by 
those engaged ta curriculum of hardware derelop- 
ment may suggest research projects to the paychol- 
ogists and sochologista, School people need to keep 


aware of new techniques and possibilities under de- 
velopment. Demonstrations need to be publicized, 
too, and the success or lack thereof prow:-.8 
further tnformation to both researchers am develop- 
ers, Finally, the existence of the dissemination 
capability itself needs to be widely publicized to in- 
sure that atl those having the need can make appro- 
prelate use of it. 


Applied to any given piece of knowledge or any 
given improvement in one or a few schocis, the 
R snd D process and the implementation of improve- 
ment process appear to be idertical. The differences 
belween the two processes begin to become visible, 
however, when the systematic implementation of 
Improvements in the entire educational system is the 
desired objective. The syatematic and continuing 
introduction of Improvements in education through 
judicious innovatton and change basea on research 
requires careful a:tention tothe different roles played 
by the many independent agencies and institutions in 
education. 


The first attempt, for example, tc tmplement a 
new curriculum tn economics In 8 secondary school 
undertaken with the ald of the original project staff 
responsible for developing tt can easily be viewed 
as the normal demonatration responsibility of the 
project. But if the scope of responsibility is enlarged 
to include developing the capability of any teaching 
staff anywhere in the country where a decision to 
implement that Curriculum has been made (that de- 
ciston assumes, of course, knowledge about the cur- 
rkculum ard a Judgement as to its suitability), the 
problem te clearly larger than an (ndividual project. 
Attention needs to be pald to the problema of devel- 
oping mechanisms for the inservice and preservice 
training of teachers iouse the new curriculum, That 
effort in turnisay point to the particular responsi- 
Diiitles of teacher training Institutions across the 
Nation both to assist In the particulae effort ard to 
insure, more genecailty, that preservice lralning ts 
undertaken Inthe light of the almost certain need 
for continutng education of leaching staff to keep vp 
with new departures in curricular *pplication. Thus 
we have mored tn this one instance very quickly away 
fror, the tndividusl school setting to the much larger 
Question of how teacher training Institutions - and 
maybe, therefore, also state teacher certification 
agencies + sre lo play theit partkular and general 
roles of enhancing the likelihood of the adoption of 
feoves. Innovation. 


The maiter can be carried etlil farther. Schoot 
boards should be apprised of the need to Continnally 
re-examine Ccerricetar objectives in terms of pee- 
sent and future social needs; a8 a consequence they 
can be expected to play a signWicant part in the net- 
works of differing responsitie agencies haring unique 
toles in the process of implementing educ sttonal im- 
frorements based on and validated by research. The 
tesonsPilities of industry In Ket ping to develop 
taaterlals, in manafecturing, and in selling them 
similarly need carefel attention. Thelr responsi- 
bilitles, M any, for training their customers in the 
use cf newly developed materials also need to be 
considered. 


Viewed on a larger ecale, then, it wockd appear 
that many of the queations associated with the acteal 
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Imple:nentation of solid Innovations system-wide de- 
pendon factors more closely related tothe dynamics 
of social change than to the actual research and 
development process itaeif. Thisdynamic- 
whether called administration, the politics of change, 
or Continuing attention tothe intricsctesot the proc- 
eas of building conviction inand a demand for more 
effective niaterials and practices in the schools - 
ia a necessary condition for the Implementation of 
the products of R and D in schools. ft constitutes, 
therefore, an absolutely essential problem for edu- 
cational R snd D strategists. 


RESEARCH DEVELOPMENT AND DISSEMINATION 
STRATEGIES OF THE PAST 


In describing the strategies of the pas, present, 
and future we have elected to characterize brosdly 
In generalized form the major outlines of attac as 
pursued until a very few months ago, the kinds of 
changes which took place and that have placed us in 
acrucis) period of transition, and the sorts of di- 
rections we project fcr the future. 


The avaitability cf militore of dollars for educu- 
tional research and development is a relatively new 
phenomenon. The recency of this growth and its 
absolute size give some pause for thought. A re- 
view of developments will help disclose the range 
of ostions available to us now snd in the future. 


The first plece of legislation «pecifically suthor- 
laing the United States Office of Educetion !o support 
research, surveys, ard demonstrations in educa 
tion - The Cooperative Research Act - was passed 
by the Eighty: third Congress in 1954. In effect, the 
Congress said that research tn education was impor- 
tant enough that the nation needed legisistion to 
authorize Federal support for it. The Act itself, of 
course. represented 8 firet step in the develcpme..t 
cf strategies tor conducting R and D to improve 
education. Four years later, in 1958, the Congress 
inc tuded twotitles inthe National Defease Education 
Act (NDEA) author leing recearck onthe uses of new 
medias and on modernforeign languages. These three 
authorisations turned oul to be but a beginning. 
There are now a total of seven pleces of tegislation 
including authorizations pertaining to rocational 
education, handicapped children and youth, libraries 
and infor mation science, and an suthorizstion under 
P, L. 480, a epecial toretgncurrency program based 
on the distritvtion et surplus foods. 


The passage and fendirg of Federal legislation 
authorizing research In education was 8 major de- 
partere inand of Itseli, R was recognition of the 
Conviction that Feder al support needed to be directed 
to a prodlem bearing dimengione larger than those 
of individeal staies and valling epon resources, 
doth financis! and Yeman, then currently beyond the 
means of siste and local educational agencies. 


The initial forays in seppoct of educational re- 
search combined the identification of areas of con- 
cern and the support of technically excellent propos- 
als sudmitted in responze to a general call. in the 
very first instance, lor example, proposals were 
requested dealing wh mental tetardstion. As the 
research programs ta dollar size, gteater 
proportions were administered on 8 pongtlorky 


basis. Areas of importance were identified perioai- 
cally and interest maintained in (those ares.s, but 
the guicing rrinciplefor the support of research was 
the technical excellence of proposals rather than the 
type of research or the substantive area of concern. 
That principte was viable because inthe early days 
of the research effort it was always possible to fund 
all the technically excellent proposals without regard 
to the fleld of study. 


Over the years, substantial amounts of applied 
research a8 well &s basic research were stimulated 
and supported. In more recent years the research 
program has moved toio two kinds of activity: cur- 
riculum improvement and the establishment of re- 
search centers designed to exp'ore programmatically 
Rand Dina defined problem area In education. 
Even with the addition of (hese new thrusts the same 
principle mentioned before was still applicable, The 
field was young and growing, but it was 6tlll possible 
to support sil of the quality proposals submittad. 


THE RECENT PAST AND 
THE PRESENT 


In 1968, several groups including staff Inside the 
Oifice of Education, a Presidential Tagk Force, and 
others begantotake a hard look at federally supported 
research in education, then nearly 9 years cid. The 
wisdom of earlier strategies was atparent. They 
had been successful = in part ber use of the avall- 
ability of dollars, in part because of the generally 
unsolicited mode ot operation - in simulating the 
growth of and interest in research and derelopment. 
The field was growing; the sub.nissions of proposals 
was increasing rapidly (in fact, at s faster rate than 
appropriations); the educations! community asa 
whole was beginning lo pay attention to the possibill- 
ties of research. 


IMPORTANT RESEARCH DEVELOPMENTE 


Research and Development Centers. Ther .#ly 
acquired visibility of research and development, 
however, led to concern over some of the spparent 
deficiencies of the total research effort as it had 
emerged to that point. Firet, it became apparent 
that the individual research projects as 8 whole - 
while the acceptable lerets of quality individually - 
did not fit together well enough to be considered 
coordinated approaches to sutatantive peodleme in 
education. The Research and Development Centers 
were in part created in response to this need, bul 
ft was felt that major chunks of the research effort 
shoald be beter coordinated and designed to lead to 
cenmulative results. 


Second, part of the difficulty is developing h:ghty 
coordinated cumatative research efforts could be 
attr buted to the inadequacy of the dissemination of 
infor mation to the educational research community 
tegarding the findings of completed research and the 
AMere Of cerrert research. A strong need was felt, 
therefore, for the establishment of an effective re- 
search dissemination system. 


Third, s carefel examination of the outcomes of 
research in termact service tothe schools reresied 
that Intwo senses Insufficient attention was being 
paid to the gap between the research stage and 
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implementatlon. First, the stage of development was 
not being supported to anything near the degrce that 
it should. Second, very little attention was being 
directed to [he change process whereby improve~ 
ments could be actually implemented in wide- 
spread fashion, 


Fourth, it was clear that the human resources 
available for R and D activities would need to be 
expanded in at least two ways. Training programs 
to develop new talent would be required. New 
agencles and institutlons previously not etigible for 
support would need to be tapped. 


Amendments to Research Acts. The responseto 
these felt needs took the form of a serles of amend- 
ments to research legislation, the creation of a 
series of new program efforts under the aegis of the 
newly acqulred authorlty, and the passage of a new 
plece of legislation, The basic plece of research 
legislation administered by the Office of Education, 
The Cooperative Research Act, was amended in 1965 
by Title IVoj the Elemeniary and Secondary Educa- 
tlon Act (ESEA). The amendments broadened the 
existing authority ~ to eupport research, surveys, 
and demonstrations In education ~ to include dis- 
semlnatlon. The range of eligible institutions was 
expanded (o virtually ail kinds of public ard private 
organizations whether profit or non-profit. Author- 
ity was included to develop programs designed to 
train educational research and related personnel, 
and to upgrade tralning programs. The Office was 
authorized to award grants as well as contracts, 
and the Commissioner was given authority to award 
funds for the construction and equipplng of facilltles 
for research and related purposes. 


These amendments vastly extended the range of 
activities possible under the research program, and 
made it feaslble for the research program to meet 
directly some of the needs identified in the reviews 
of the program to that time. In addition, the testi- 
mony before the Congressional committees - or the 
legisiatlve history, as it {s called - made it very 
clear that the broadened authority was to be used 
to bridge the gap betweenresearch and practice and 
to pay substantially more attentlon to the problems 
of implementing the knowledge dertved from the 
research efforts to date andinthefuture. The 
broadened responsiblilties represented by these ad- 
ditlonal authorizatlons have created new demands on 
the admlnisiration of research and at the same tlme 
have offered new tools for meetIng emergent short- 
comfigs of the research effort. 


Training Program. To date, three major new 
program thrusts have undergone spirited develop- 
ment. A tralning program designed to expand the 
corps of educational researchers has been dev-zloped. 
This program provices bota program development 
grants and an array of training mechanismsranging 
from institutes of short and long duration through 
undergraduate and graduate tralning programs to 
a smaJ! postdoctoral effort (Clark, 1967). 


Educational Research Information Center. The 
Educational Research information Center (ERIC) 
has been established with Central ERIC, twelve 
clearinghouses, and more to come. ERIC is de- 
signed to provide to researchers and practitioners 


alike an informatlon storage and retrleval mechan- 
ism to make avallable instantly in easily accessible 
indexed form allthe researchandrelated data 
relevant toa particular problem, Research in Edu- 
cation, the monthly publication of the ERIC system, 
has now published several issues and already the 
usefulness of this effort has begun to prove ltself. 


Educational Laboratories. The third and largest 
development In the research program has awakened 
the Interest, excitement, and the enthusiasm of the 
entlre educatlonal community from local schools, 
state agencles, and teacher training institutions to 
industry, scholars from the arts and sciences, and 
the lay public. We refer tothe National Program 
of Educatlonal Laboratories. Drawing from re- 
sources in regions extending across the nation, new 
institutlons called educatlonal laboratories have been 
created to bridge the gap between research and prac- 
tlee. These institutions were created by represen- 
tatlves of all the many agencies and institutions 
which play dlfferent roles in the implementation 
process, They are reflections of the conviction that 
it is not enough to do research; that research must 
be followed up by development project which, having 
established the desired objectives - whether curri- 
cular. instructicnal, organizational, professional, 
or technical ~ then move to the development of solu- 
tions drawing upon the best that research hasto 
offer. The laboratorles have atso been charged with 
the responsibllity for active disse minatlon campaigns 
based on the successfvl develonment projects they 
ard others engage in. 


We have encouraged the laboratorles to conceive 
thelr responsibilities broadly - encompassing much 
more than merely the distributlon of information, 
although that is a critically important functlon among 
many. Clearly, one of the imporiant steps in the 
diffusion of research-based improvement throughout 
the educational system 1s the estabJishment of demon- 
stratlons. First time demonstrations of feastbllity 
will be the direct responsibility of the laboratories; 
the more widespread diffusion of the successful in- 
novations will depend on the degree to whica infor- 
matlon about the innovation is distributed to various 
parts of the systems, the degree to which the Innova- 
(lon recommends itself to pruiessionals, and the de- 
gree to which credible demonstrations of the new 
practice or curriculum are mountedinschools. This 
last part of the diffusion process - the establishment 
of real-life (not hothouse) demonstrations of the in- 
novation without the Intervention of the i:ventor ~ 
represents a place where the labs can work with the 
state education agencies and local school districts 
to make use of Title Il of ESEA. Such demonstra- 
tion efforts must be coordinated and well-concelved. 
Labor ator‘es can help only in their areas of compe- 
teuce and program thrust and only by cooperating 
ch .+ly with state education agencles and the local 
school districts. 


The laboratories were conceived insuch a way as 
to invo" # in thelr government and their operation the 
many ty pes of differentresponsibllitics and resources 
that combine to forra the educational system as we 
know ft. The hope is that these new {nstitutions ~ 
responsible for their own program development and 
implementation and knit closely together to forma 
network = will, aa thelr resources permit, at one 
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and the same time engage In 1) najor efforts to, 
develop new materials, practices and organizations 
using the outcomes of research; and 2) by utlllzing 
the expertise brought to them by the involvement of 
different agencies and institutions, pursue courses 
of action which help to hasten the process of Im- 
provement once tested innovations are available, 


The strategy for tlese three new program thrusts 
is stralghtforward. If there is to be an expansfonin 
research and development, people will need to be 
tralned or recruited from rew areas to fill the de- 
maid, In order to bul! structures of knowledge and 
cumulative improvement, dissemination networks 
and the material which moves through them wlll need 
to be better systematized and improved. Finally, to 
fill the gap between research and practice, anew 
autonomous institution drawing institutionally and 
representatlonally on many resources in the educa- 
tion system has been crec.ted. 


TITLE ll OF ESEA 


In addltion io the new authorizations for research 
and the programs mounted as a result of them, the 
Eighty-ninth Congress passed Title III of the ESEA. 
This program, authorlzing support for projects sub- 
mitted by local educational agencles designed to sup- 
plement existing school programs or to serve as 
models for existing school programs, was an inno- 
vation in Itself. When (former) Commissioner Kep- 
pel testified before the House Subcommittes on the 
Elementary and Secondary bill, he told the Congress- 
men that he viewed Title III and Title WV together. 
Title TV was to be the means whereby the substance 
of educatfonal improvement would recelve increased 
impetus and attention; Title III would be the means 
by which local schools could inaugurate the kind of 
credible real-life demonstratlons which would be 
convincing to thelr counterparts and become there- 
by one of the moving forces for the widespread adop- 
tion of tested innovation. Those responsible for 
Title IIT estimate that this past flscal year fully 60 
percent of the money went to support projects relat- 
{ng to the functions of development and demonstra- 
tlon. This year the program expects to do at least 
as well. Most important, for the first time local 
educational agencies were provided with the funds 
and the encouragement to experiment with new ideas. 


CURRENT DEMANDS AND 
STRATEGIES FOR THE FUTURE 


A thorough consideration of the present status 
of educational research on the basis of five var la- 
bles provides important clues tothe directions 
future stralegies may well take. Those five varta- 
bles are discussed briefly in the following para- 
graphs. 


VARIABLES RELATED TO STRATEGIES 


The Research Function. The research function 
has been charged broadly with 1) the basic research 
responsibilitles relating to fmproving our under- 
standing of the nature of learning and the conditions 
for it, 2) developing materials, practices, processes, 
and Institutions designed to Lmprove instructional 
practices, and 3) engaging ina range of activities 


running from demorstratlon to dissetnination totrain- 
ing, In order to ensure that improvements find their 
way to implementatlon In operational settings. 


The Financta} Demand. Tha financialdemand, 
represented by the broad responsibllities Indicated 
above, is difficult to estimate with precision, but 
Its dimensions can be sketched. Recent ¢xperience 
accumulated by the Natfonal Science Foundation, the 
Office of Educatlon, and the Office of Economic Op- 
portunity has shown that full-scale multi-medla cur- 
riculum development can range in cost from $2 mil- 
lion to $6 million per course; even this expense is 
engendered by building curriculums for schools as 
they are presently structured. The costs for simi- 
lar development for newly or ganlzed institutions 
might well be more. In any case, however, it does 
not take very complicated arithmetic to multiply the 
above figure by the number of possible course ex- 
periences that might be developed for preschool, el- 
ementary, secondary, community college, under- 
gcacuate, graduate, and adult educatlon. If one as: 
sumes, as we think is reasonable, that such curric- 
ula probably ought to be redeveloped every § or 7 
years it is not unreasonable to project an annual ex- 
penditure of a half billion dollars just for currlculum, 
hardware, and organizational development alone. 
The research effort to suppor that kInd of develcp- 
ment effort will add another $150 million to $ 200 
million to that flgure annually. The cost of demon- 
stratlo' « must also be added - perhaps as much as 
$300 million or $400 million annually. A rough rule 
of thumb for dissemination activities indicates that 
approximately 5 to 10 percent of the research effort 
ought to be spent in that area. We can add conserv- 
atlvely for that purpose another $30 million. The 
total is slightly more than a billiondollars annually, 
an amount which ~ if added to the current estimated 
expenditures of educational institutlons for thls fis- 
cal year — would constitute just 2,2 percent of the 
total. That rate of expenditure for research and de- 
velopment approximates the minimum percentage de- 
voted to R and D today by Americanindustry. It 
strikes us as reasonable that the educatton industry, 
with estimated expenditures of $48.8 billlon infiscal 
1967, saould devote a simllar proportion of effort 
to research and development In areas relevant to Its 
mlsslons. 


The Dollars Available. The actual dollars avail- 
able for the broad range of actlvitles associated with 
the research effort have grown dramatically. They 
are by no means equivalent to the demands briefly 
sketched above. But major funding for research 
and related activities {s still in its infancy. Signifi- 
cant educational research funding began only in 1957 
at a combined USOE/NSF level of $1.7 million and 
has grown this year to an annual level of $200 to $ 220 
million including USOE research appropriations, the 
NSF Course Content Improvement Activities, other 
miscellaneous agency expenditures, and Title Il of 
ESEA (assuming that the 1966 prorortion - 60 per- 
cent - of the Title III, ESEA, activities going to de- 
velopment and demonstration holds for 1967). ? 


This level of funding, matched with the estimate 
of the conceivable demand for funds forresearch 
and related activities, underscores the critical na- 
ture of the allocation of f{nancial resources. 
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Manpower Resources. The problem of manpower 
resources is of crucial importance and is not easlly 
resolved. Adirect response, although a long-range 
one, is to train a new corps of professionals having 
the klads of skitls required to perform the entlre 
range of research functions, There are other pos- 
sible approaches, however. There already are ~ 
In other disclplines and in other kinds 0: institu- 
tions - Individuals skilled In the research and devel- 
opment environment, and who could probably be per- 
suaded to turn their attention to the fleld of educa- 
tlon. These consideratlons were in no small meas- 
ure part of the strategy behind hroadening ihe list of 
eligible organizations to participate inR and D. They 
also played a major role in the early decision inthe 
administratlon of research to secure the active in- 
volvement and participation of arts and sclences 
diselplines in educatlonal research, a strategy that 
has continued until now and willbe maintained In the 
future. 


The combination of approaches adopted for the 
provision of adequate manpower supplies can be ex- 
pected, then, to have considerable bearing on the 
possibilities for growth (see Clark, 1965; Guba and 
Elam, 1965; Hopkins, 1967). 


Successses of Past and Current Efforts. The 
successes of educational research and development, 
the growing visibility of operations in this area, and 
the {ncreasing conviction that research will in the 
long run provide the basis for substantive Improve- 
ments in education have created new demands upon 
the human and financizi resources available to the 
research enterprise. As soon as the demand out- 
stripped the resources, something thatharpened 
only very recently, the entire picture of support 
necessarily was altered. It has now become neces~ 
sary to allocate limited resources in the face of de- 
mande which exceed those resou. ces. 


ADDITIONAL STRATEGIES ADOPTED 


The {lve considerations discussed above have led 
to the adoption of additional strategles. Broadly 
speaking those strategies embrace the three princi- 
pal functions discussed below. 


Careful Long-Range Planning. Now that the de- 
mand has Clearly out-stripped the supply of re- 
sources, particularly in the financlalarea, it is 
critically important that the allocation of research 
dollars to varlous research functions and to purtic- 
ular toples or areas of developinent be accomplished 
in a careful and logical manner. This must be done 
in ways to ensure that both short-term and long- 
term interests are met, and to maintain and 
strengthen the existing political structure of educa- 
tlon as it has developed over the years. 


The careful long-range planning of those re- 
sources ig much more likely to produce optimum 
levets of support for all the different functions and 
areas for research and development than isatotally 
non-directive approach embracing the competitive 
selectlon of technically excellent but unsolicited pro- 
posais for support. Such planning will need to take 
Into consideration the instructional and administra- 
tlve needs of the different educational levels and the 
many kinds of agencies, Institutlons and organiza- 


tions in the fleld of education, industry, the profes- 
stons, and government. Attentlon will huve tobe 
given to the needs of different target populations, in- 
Cluding the general student, the handicapped, the dis- 
advantaged, and the gifted. This implies, ofcowse, 
that it will be necessary for usto develop much 
more effective mechanisms fer planning research 
and related actlivitles in order to ensvuve that all rel- 
evant data are canvassed and that maximum flexibll- 
ity Is built into the planning and administrative pol- 
icies devolving frem that planning. We must be 
careful, for example, thet we continue to pursue 
the wisdom of earlier efforts in support of research 
by maintaining a significant portion of the research 
budget for unsolicited efforts. This {s only one ele- 
ment of the larger planning pleture, however, al- 
though a very important one, 


Ab part of the attempt to improve the data on the 
basls of which research and other educational plan- 
ning is now done, the Bureau of Research has re- 
cently called for proposals to begin pilot projects 
we hope will ultimately lead to the establishment of 
educational policy centers. These centers would, 
on a continuing basis, conduct the kinds of siudler. 
which would enable all of us to have better ideas, of 
the 5-, 10-, 20-, and 30-year picture for education. 
How should or might the schools relate to the soci- 
ety? What should the range of curricular objectives 
be? What kinds of sources might exist for financing 
education? How might schooling be structured inthe 
soclety in the years tocome? What technologles 
are likely to be avallable? These centers will not 
be engaged in predicting what the fnture will be, In- 
stead, they wlll try to project the many alternatives 
available to us, cost them out, examine the conse- 
quences, and thus provide much betcer data to policy 
planners than are now avallable. They will provide 
a new kind of information and analysis looking to the 
future in a systems-orlented interdisciplinary way, 
supplementing the improve present-orlented data 
collection which must also accompany the planning 
process (see Goodlad, 1967), 


The Outputs of Research Process, Our concern 
for the outputs of the research process is pragmatic 
In part, but it is tied closely to our conception of the 
mission of the research effort in education In gen- 
eral and of USOE’s research progiam In particular. 
We have stated our faith ‘hat the improvement of ed- 
ucation depends in the long runon the systematic 
prosecutlon of a well-concelved R and D effort. The 
improve ment of education is the fundamental thrust 
of the miss{on; that criterion must be the continuing 
evaluative guide we employ in judging the success 
of our efforts. 


While It is true that the justifieatior: for support- 
ing research and related activities in education with 
public money ¢an only be the eventual and signiflcant 
betierment of the educational system as a whole, It 
ls also true, happily, that the more we can demon- 
strate that research has affected schoo! practices In 
a positive way, the more likely It will be that great- 
er support for the entlre research process will be 
forthcoming. Thus we believe that such objectivesare 
not only good public policy, but good politicsas well. 
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There can be nodenying the growth and the 
strength of the interest in results. The Congress 
is concerned, The Executive Branch is concerned. 
Local school! people have made their Interest felt In 
a number of ways, particularly tn the development 
of the programs for the educatlonal laboratories, 


We believe, however, that a strong amd continu- 
Ing tension exists between the conduct of research 
designed to increase our knowledge of basic tearn- 
ing procésses, for example, and the pursuit of de- 
velopment projects designed to yleld specific out- 
comes for instructional use. The demandfor re- 
sults uas raised the appropriate and throughly justi- 
flable concern of the academic and scholarly re- 
search community that such demands may tend to 
compromise the long-rarge efforts which are so 
badly needed. The continuing tensionbetween short- 
term and long-term requirements — between today's 
youngsters and tomorrow's — isreal and constitutes 
one of the continuing nightmares of the research ad- 
mintstrator. This problem is the responsibility of 
the administrator of research, and it must be square- 
ly met. We telleve that it is important that the two 
functions not be confused, but thatthey both be 
served with sophistication and energy. 


The importante of concentrating on the improve- 
ment of schools, and the significance of development 
profects in that effort, signals an increasing atten- 
tion to such activities as curriculum development 
and explicit altempts to Improve instructional prac- 
tices. We are Increasingly persuaded, for example, 
that prudent managenient of the limited resources 
available at the present time makes it necessary for 
us to adopt a research strategy that relates applied 
research projects closely to identified development 
efforts. We would hasten to add that the preserva- 
tion of a signficant portion of funds for unsolicited 
proposals will still permit the support of some ap- 
plied research unrelated to development since good 
ideas will also be generated independentty of develop- 
ment projects or research planning groups and 
should be supported on their own merits. 


We anticipete, then, still further increase In at- 
tention to development kinds of tasks designed to 
produce substantial, measurable, and cumulative im- 
provements in the nation’s schools. 


Continued Expansion of Research and Related 
Activities. There is no question {nour minds, as 
all the preceeding analysis should clearly indicate, 
that research and related activities must continue 
to expand in rapid but judicious ways. By directing 
ovr attentlon to the developrnent of coordinated strat- 
egies for the support of research with the Implica- 
tlon that greater attention will be paidto the out- 
comes of the research effort, we belfeve that con- 
stituencles in support of educational research will 
grow and the dollarg available for the functton will 
Increase to what we believe are the regular min!- 
mal levels we suggested eariier. 


SUMMARY 


In this paper we have sketches out the two parts 
of the change process: research and development, 
on the one hand, and implementation, on the other, 
We have suggested that the principal purpose of the 


research effort ought to be viewed as the improvement 
of education Inthe schools. We have Indicated the 
national need for research, and the importance 
of drawing on national resources to meet that need. 
We have described the discrepancy betueen the po- 
tential size of the need in dollar terme and the actual 
fiscal resources available. We have suggested that 
these conditions lead us to adopt, in effect, multlple 
strategies for Rand D. These include: 1) better 
planning of the research effort; 2) more attention to 
the training of research and related personnel; 3) the 
establishment of new Institutions — the laboratories - 
and new programs -— Title III - to greatly Increase 
the opportunities and responsibilities of local schoo! 
officials {n the research and implementation proc- 
ess; 4) the continuation of significant proportions of 
unsolicited research and development funds; and 5) 
increased aitention to development efforts designed 
to yleld better materials, equipment, and instruc- 
tional practices for the schools. All of these strat- 
egles will, we hope, lead to increaseaunderstanding 
of the ultimate Impact of the research effort, help 
to bring about substantial increases inthe amount of 
support committed to research and development In 
education, and will provide the foundation for the con- 
tlnuing improvement and self-renewal of our educa- 
tional system. 


NOTE: Dr. R. Louls Bright ts no longer with the 
United States Office of Education. He is presently 
iocated at Baylor University in Waco, Texas where 
he is a professor. 


FOOTNOTES 


1, Digest of Educational Statistics, 1966, U.S. Gov- 
ernment Printing Cifice, Washington,D.C., 
1966, p. 17, 


2. The imprecision in the estimate derives from a 
number of considerations. The research au- 
thorizations of USOE In FY 1967 total $99 mil- 
lion, but $8 milllon are for training and an- 
other $14 million are for covstruction. The 
Nattonal Science Foundation spends close to 
$17 million a year oncurricuium development, 
and almost cerlalnly some of the curriculum 
development efforts of the Officu of Economic 
Opportunity will be used by schcols, Similar- 
ly, the National Instltute of Mental Health and 
National Institute of Child Health and Human 
Development also spend a considerable amount 
on research related to areas of interest to 
learning and education. Title Il of ESEA, if 
past percentages hold, could well spend $81 
million on development and demonstration ac- 
tivities. Part of the development of strategles 
for educational R and D is the ¢ :0rdinatlon of 
these several sources of research and re- 
search related funds. 


3. The actual figures by program and year are as 
follows: (See chart on following page.) 
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USOE NSF Course Title M1, ESEA 

Research Content Dey, and Dem. 
1954 | ere $ 1,125 
1955 sees 35, 000 
1956 eons 18, 000 
1957 1,020, 000 650, 140 
1958 2, 300, 000 750, 310 
1659 8,716, 000 6, 180, 485 
1660 10, $59, 000 6, $02, 055 
1961 10, 117, 750 6,167,740 


1962 11, 770, 000 9, $89, 948 
1963 14,188,400 12,626,771 sa 
1864 19,820,000 14,157,650 ss ee 
1965 37,108,000 = 14,889,081 iw ss 
1966 = 100,141,241 16, 393,389 1 400, 
1967 99,600,000 17,000,000 (est.) 81, 000, 000 (ext.) 
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sca sas a ere wvarebcherg 


wax The Wisconsin Research and 


Development Center 


for Cognitive Learning 


THE AGREEMENT between The Uni- 
vers\ly of Wisconsin and the United States Office of 
Education (USOE) eslablishing the Wisconsin Re- 
search and Development Center for Cognitive Learn- 
ing was signed on August 6, 1964. The high expec- 
tations held for the Cenler were expressed by the 
principals to lhe signing in a number of ways. 


University President Fred Harvey Harrington 
remarked that the signing denoted ‘‘... an impor- 
tant day in the history of the University. This agree- 
ment marks the culmination of years of effort de- 
voted to the Improvement of the research capabili- 
Ules of the School of Education, and opens the way 
to slill greater developments. ”’ 


Howard F. Hje)-:, then director of basic re- 
search for USO®, described the agreement as fol- 
lowing the new patlern in educational research of 
full institut!onal commitment. He stated: ‘‘The Uni- 
versity b2s pledged itself to fully investigate the 
problem of learning and to disseminate research 
{Indings in a way which will bring about definite 
changes in school practices, ’’ 


Hjelm found the University well suitedfor the 
commitment it had accepted. ‘‘The University was 
chosen because of the exceptional quality of its edu- 
cational researchers, because of its excellent rela- 
Uonship with local schools and with the Stale Depart: 
ment of Public Insiruction, and because of the whole- 
hearted dedication to the project existing in Madison, 


Center Director Herbert J. Klausmejer stated 
the primary focus of the Center: ‘‘Research empha- 


. 


wemmmea Herbert J, Klausmeier 


The University of Wisconsin 
Madison, Wisconsin 


ses will be on learning by children and youth in nor- 
mal school situations. Especially stressed will be 
the learning of voncepts and problem-solving tech- 
niques in mathematics and olher basic subjects.’’ 


The Wisconsin R and D Center was established 
under provisions of the Cooperative Research Pro- 
gram of USOE. In 1964 tie Cooperative Research 
Program included six major areas: 1) basic and 
applied research, 2) demonstration, 3) curriculum 
improvement, 4) small contract, 5) research and 
development centers, and 6) developmental activl- 
tles, Further description of the research and de- 
velopme:t centers was given lu OF Publication 
12017, 1963. as follows: 


Research and development centers are de- 
signed to concentrate human and financial re- 
frources On a particular problem area In edu- 
cation over an extended period us time in an 
attempt to make a significant contribution to- 
ward an understanding of, and an improvement 
of educational practice In, the problem area. 
More specifically, the personnel of a center 
will: 

i. Conduct basic and applied research studies, 

both of the laboratory and field type. 

Conduct development activities designed to 

translate systematically research findings 

inlo educational malerials or procedures, 
and field test the developed products, 

3. Demonsirate and disseminate Informalion 
about the new programs or procedures 
which emerge from the research and devel- 
opment efforts. These activities may 


2. 
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include demonstrations in a natural, or 
operational, setting; the preparation of 
films, tapes, displays, publications, and 
lectures; and the participation in symposia 
and conferences. 

4. Provide natlonwide leadership In the chosen 
problem area. 


The preceding ideas about the programmatic re- 
avarch, development, and dissem!{nation thrust of 
an R and D Center in relation to a significant prob- 
lem area in education followed logically from expe- 
rience with other programs of the Cooperative Re- 
search Program of the Office of Education, the first 
of which, basic and applied research, started ona 
modest scale in 1956. Also, the research and de - 
velopment strategy had demonstrated a high yleld 
in selected aspects of industry, agriculture, medi- 
cine, and space exploration. A large segmentof the 
American public desired {mproved educational prac- 
tlces. Relevant USOE, university, and other con- 
cerned persons throughout the nation felt thata pro- 
gram of research and development centers would 
be equally effective in improving educatlon. 


An R and D Center, designed to lmprove educa- 
tional practices through programmatic research 
and development, might be considered as a concept. 
As we know, concepts are abstractions of realitles. 
A concept is comprised of the attributes, or proper- 
tles, of things and events, the attributes being 
Joined by rules, or ways of combining attributes 
systematically. Au Rand D Center then may be 
underetood in relation to various attributes and how 
they are combined to form a whole. The writer hy- 
pothesizes eight crucial attributes of anR and D 
Center as follows: problem area, outcomes sought, 
research and development program and strategy, 
disseraination and adoption program and strategy, 
staff, administration and management, locus of op~ 
eration, and source and stability of funding. The 
preceding attributes may be considered asthe major 
components of a system, or instrumentality, de- 
signed to achieve certain general objectives implied 
by the problem area. Thus, a systems approach Is 
properly followed in organizing and managing the 
Center operations and programs, The r2mainder of 
this chapter is devoted to a discussion of the var lous 
components of the system, their relationshins, and 
the outcomes attained thus far by the Cente. staff. 


Before further description of the WisconsinR 
and D Center, it should be recalled that the Elemen- 
tary and Secondary Education Act of 1965 a» noted 
by Bright and Gideonse in the previous chapter, pro- 
vided for the establishment of regional educational 
laboratories and Title III demonstration and ado p- 
tlon centers in loca! schools. These two programs 
of USOE are much larger than the current R and D 
Center Program. As Instrumentallties for improv- 
ing educational practices, the writer hypothesizes 
that they, too, can be described and understood in 
terms of the preceding efght attributes of a center. 
It is not the purpose of this chapter, however, to 
point to the similarities and differences among the 
vartous research, development, and demonstration 
instrumentalities of the USOE but to describe the R 
and D Center of Wisconsin as an example of a signif{- 
icant contributor to the extenslon of knowledge about 
cognitive learning and the improvement of related 


educational practices through research and deve }- 
opment. 


PROBLEM AREA 


The problem area of the Center is the improve- 
ment of education through a better understanding of 
cognitive learning. The importance cf this problem 
area may be inferred from flve propositions regard- 
Ing learning and instruction. 


The first proposition Is that concepts provide 
much of the basic matertal . thinking. Concepts 
possessed by the individua’ .:nable him to interpret 
the physical and soclal world and to make approprl- 
ate responses. Concepts once learned then serve 
as symbolic mediators between sensory input and 
overt behaviors, Without concepts withwhich to 
think, man, Ike lower-form animals, would be lim- 
ited mainly to dealing with sensorimotor and percep- 
tual representations of reality, closely tied to im- 
mediate sensory experiences. 


A second proposition is that concepts and cogni- 
tlve skills comprise the major outcomes of learning 
in various subject flelds. Sentence, noun group, 
and transforms represent four concepts in Engllsh 
syntax. Set, number, and fraction represent con- 
cepts in mathematics. In order tolearn the con- 
cepts of a discipline, a student must acquire cognl- 
tive skills. In mathematics these skills are deslg- 
nated by such terms as arithmetic comprehension 
and problem solving. The identiflcationof concepts 
and their arrangement ina hlerarchical order and 
the identification of cognitive skills are principal 
concerns of scholars and curriculum workers in the 
various subject fields. 


A third proposition, related to the preceding 
ones, is that the acquisition of cognitive skills en- 
ables man not only to acquire the knowledge of oth- 
ers but also to generate new knowledge. Cognitive 
processes, such as cognizing, hypothesizing, and 
evaluating information, are learned. These and 
other processes, combined with cognitive contents, 
are designated cognitive abllities or skills. When 
the child has learned the cognitive skills of reading, 
he can acquire knowledge in the absence of other per- 
sons. Whenhe has mastered mathematical concepts 
and conipuiational skills, he can find solutions to 
problems not encountered inthe same form by any 
other person. 


A fourth proposition is that efficient learning of 
concepts and cognitive abilities is related to condi- 
tions within the learner and conditions within the 
situation. Two conditions within the learner asso- 
ciated with efficlency of learning are attention, re- 
lated to motivation, and level of cognitive function- 
ing. In school settings, the preceding conditions 
related to the student and other conditions relatedto 
the content and sequence of instruction, quality and 
availability cf equipment and materials, and quality 
and methods of instruction are paramount. More ef- 
ficlent learning can be attained through better c on- 
trol of these conditions. 


A final proposition is that knowledge about cogn!- 
tive learning, concepts, cognitive skills, and con- 
ditions of learning generated by scholars requires 
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validation in school settings. Although the study of 
cognitive learning is in its infancy, sufficient knowl- 
edge has been generated to develop {nstructional the- 
ory regarding the teaching and learning of concepts. 
The validity of the theories must be tested in schoo] 
settings. Similarly, instructional materials for 
children and outlines of concepts for teachers must 
also be tested for usefulness and validity in school 
settings. 


PROGRAMS, STRATEGIES, 
AND OUTCOMES 


Strategies best sulted to achieve the Center goals 
include the differentiation of the problem area into 
research and development programs and other pro: 
grams. The three research and development pro- 
grams are titied Processes and Conditions of Learn- 
ing, Processes and Programs of Instruction, and 
Facilltative Environments; the other programs deal 
with Dissemination, Training Activities, and Tech- 
nical Support. These programmatic activities are 
designed to concentrate and utilize human and mon- 
etary resources most effectively over an extended 
period of time. Each research and development 
program is characterized by a sufficiently shar p 
focus to assure its identity and by a relatedness of 
content and methodology that facilitates the free flow 
of information and personnel among programs. Fig- 
ure 1 shows the major operation of the Center and 
the program components. These operations and 
components are now described in some detail, with 
attention first directed tothe three Rand D pro- 
grams and later to the other programs. The objec- 
tives of each program are gives. and outcomes at- 
tained through 1968 are summarized. 


PROGRAM 1 -- CONDITIONS AND PROCESSES OF 
LEARNING 


To increase our understanding of conditions and 
processes of cognitive learning, basic research is 
needed. ‘To test in school settings the knowledge 
from basic research, relevant models and systems 
must be developed. To meet these requirements, 
the research and development aclivities comprising 
Program 1 are directed toward: a} generating new 
knowledge about concept learning and cognitive skills 
by conducting laboratory-ty pe experiments or re- 
search within the school setting; b) synthesizing ex- 
isting knowledge and developing general taxonomies, 
models, or theories of cognitive learning; and c) de- 
veloping educational materials suggested by the pri- 
or activities. 


Substantive information from the basic studies in 
learning ieeds directly into the area of instructional 
{mprovement, thus providing from the behavioral 
sciences a foundation for the developmentof instruc- 
tional programs. Also, methods developed in the 
behavioral sciences are utilized in the researchand 
development activities of Program 2, At the same 
time, the behavioral scientist in Program 1, when 
dealing withthe learning of content in a subject field, 
utilizes personnel from Program 2 and other 
sources who are expert in the subject field, familiar 
with Instructional processes, or both 


Basic research in cognitive learning has been 
conducted by the Center staff and reported regard- 
ing concept léarning, creativity, prereading skills, 


tule learning, the shaping of complex human behav- 
lor, group pressures on individual performance,and 
the transmission properties of various media. Rel- 
evant results from these studies have gone into the 
development of instructional programs. Inadditlon, 
a system of motivation was formulated and put into 
Operation in selected elementary schoois during 
1967-68. Creativity training materials and proce- 
dures were prepared and received initial testing In 
selected schools in 1967-68. Procedures for teach- 
ing severely retarded readers were developed and 
field tested, starting in 1965, and were used opera- 
tionally in selected schools in 1967-68, Other basic 
research dealing with concept learning and cognitive 
silis is continuing and is being applied to improve- 
ment of instructional programs in arithmetic, Eng- 
lish, reading, and science, 


PROGRAM 2 -- PROCESSES AND PROGRAMS OF 
INSTRUCTION 


What is an appropriate unit to deal with when at- 
tempting to improve instruction, or stated differ- 
ently, to achieve greater efficiency of student learn- 
ing? The Center staff and schoo] people decided that 
it is each building or an integrated set of bulldings 
which the same children attend rather than individual 
children, separate classrooms within a building, or 
all the buildings of a local school system. Within 
each building, the instructiora] and other staff must 
deal with all the components cf an instructional sys- 
tem, Similarly, the Rand D staff, particularly 
those in Program 2, are concerned withallthe com- 
ponents of an entire instructional system, although 
they may give much more time and effort to devel- 
oping and testing one component rather than to 
another. Figure 2 outlines the major components of 
a total instructional system that are relevant to 
a school building. The order from topto bottom 
alzo indicates the general sequence inwhich the 
staff of the R and D Center and schools move in de- 
veloping a prototypic system, such as In reading, 
mathematics, science, and English. Variables as- 
sociated with each component require research. 
Thus, research on instructional processes and the 
development of instructional programs are essential 
inthis program. The specific objectives of Pro- 
gram 2 are: a) to establish a rationale and strategy 
for developing instructional syste ms inthe cognitive 
doniain; b) to identify by careful syathesis and 
further research sequences of concepts and cogni- 
tive skills within and across disciplines; c) to devel- 
Op assessment procedures and materials for the con- 
cepts and skills identified above; d) to identify exiat- 
ing materials or developnew instructional materials 
fasociated with the concepts and cognitive skilis;and 
€) to generate new knowledge through research about 
instructional procedures including motivation, indi- 
vidualization, classroom management, and organi- 
zation of instruction. 


Executing the activities of this program requires 
specialists in 2 subject field, {n instructional meth- 
ods, or both, with assistance from behavioral sc!- 
entitts and communication experts. Each project 
in this program has at least one staff member whose 
speciality is cognitive learning. In addition, the 
program utilizes the many resources outside the 
Center including the University educational TV sta- 
tion (WHA-TV) and Educational Testing Service. 
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Figure 1: Major operatlons and components of the Wisconsin R and D Center for Cognitive Learning 
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The largest instructional program developed by 
the Center staff through 1968 was Patterns in Arith- 
metic, a program comprised of 7'V video tapes, stu- 
dent lessons, and teacher notes. It is designed as 
a complete program of materials for children and 
also for simultaneous In-service education of teach- 
ers. As of 1967-68 the materlals for Grades 1-4 
had been developed and initlally tested and were un- 
dergoing further fleld testing in many schools of 
Alabama and Wisconsin. The program for Grade 5 
was being completed. The development of a proto- 
ty ple instructional program, not using TV proce- 
dures and materials, dealing with concepts in math- 
ematics, Kindergarten-Grade 8, was started in 
1967- 68, 


Fundamental research was conducted and re- 
ported on the learning and teaching of reading, 1966- 
68, and is continuing. An outline of major content, 
behavioral objectives, and related appraisal proce- 
dures was developed, Kindergarten-Grade 6, and 
relevant instructional materials and procedures 
were Sdentified. The entire prototypic instructional 
system was piloted in selected elementary schools, 
1967-68, as cooperative school and Center activi- 
Hes, with substantial support of ESEA ‘Title III and 
Title I funds. 


An outline of concepts relied to the particle na- 
ture of matter and enyironmeatal conservation, ap- 
propriate for the elementary-school science pro- 
Gram, was developed, 1965-68. Research on In- 
structional methods was reported and other research 
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is continulng. Preliminary instructional materials 
and methods appropriate to the concepts were devel- 
oped during 1967-68 and initlally tested. Related re- 
search and the development of scientific equlpment 
and materials {s continuing. 


A prototypic program of instructlon In English in 
the junior highschool was under development, start- 
ing In 1966. An outline of selected concepts of Eng- 
lish syntax and a related set of programmed instruc- 
tional materials to teach the basic concepts were de- 
veloped and field tested during 1966-67. Further 
tev‘ ing of the programmed material, and implemen- 
tatlon of the entire curriculum, was started in selec- 
ted junior high schools during the 1967-68 school 
year and {s continuing. Basic research on proces- 
ses and conditions of learning 1s continuing. 


An outline of concepts in verbal argument was de- 
veloped, 1965-67, and related tests oferitical think- 
ing were also developed and initially validated. Pro- 
grammed material was prepared during 1967-68 to 
teach these concepts. Further research on the pro- 
gram and validation of the tests continued, 1267-68. 


Two other sets of activities have high priority 
for initiation in subsequent years. Research and re- 
lated development regarding social studies in the 
elementary school are projected. Greatly Increased 
use of the computer in research and in the manage- 
ment of individually guided education is the second 
fleld to be givi-n increased emphasis. 
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Figure 2; Major components of an instructional system 
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An outline of content--cognitive, psychomotor, affective-- 
to be learned. 


A statement of related behavioral objectives, or desired 
terminal behaviors of students, related to the content. 


Instructional materials, media, and consumable supplies 
to be used. 


Student activities-- one-to-one, smail group, ciass- size 
group, and Independent study to achieve the objectives. 


Teacher actlyities-- organization and direction of student 
learning activities, counseling and guiding students, 
classroom management, other functions. 

Procedures for placement and management of students. 

Organization for instructlon--nongraded units. 


Procedures for scheduling flexible use of time, space, 
and equipment. 


Cther: In school--other educat{onal personnel. 
| Out-of-school--home, neighborhood. 


Vv 
Students with terminal behaviors 
and characteristics < 


PROGRAM 3 -+ FACILITATIVE ENVIRONMENTS 


Achieving Improved educational practices re- 
quires facilitative environments in selected local 
school buildings, in total school systems, and among 
various agencies. Thus, the research and develop- 
ment activities within this program are designed a) 
to develop and test new organizations and relation- 
ships among staff that facilitate research and devel- 
opment activities on cognitive learning in schools, 
and b) to develop and test the effectiveness of the 
means whereby schools select, introduce, and utlI- 
lize the results of research and development. The 
same schools that facilitate student learning atso 
serve as demonstration centers for entlre school 
systems and the R and D Center. 


In seven school systems of Wisconsin environ- 
ments were established, 165-68, designed to facil- 
itate the research ard development activities of the 
Center and the learning of children througha system 
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Measurement Tools and Evaluation 
Procedures 


To assess student's 
prior achievements 
or readiness to en- 
gage in specific ele- 
ments of the program. 


To ascertain student's 
intellectual abilities 
and other characteristics. 


To measure and evaluate 
Student's progress 
during short and long 
Intervals. 


To evaluate the separate 
components and the total 
system. 


of individually guided education. Anew organization 
for instruction that replaces the self-contalnedclass- 
room by instruction and research units and an In- 
structionat decision-making committee [san Integral 
component of the facilitative environment of the Mul- 
tiunit School. The organization is shown in Figure 
3. The characteristics of individually guided educa- 
tion and of the organization which facilitates its ex- 
ecution merit further attenticn. 


The Multiunit Scheol organization includes botha 
formal organizational structure and a procedural 
style consisting of several essential components as 
shown in Figure 3. The organizational nferarchy of 
the Multlunit School consists of groups at three dis- 
tinct levels of operation. 


At the classroom level are (he Instructional and 
Research (1 and R) units. EachIand Runit hasa 
unit leader or professional teacher, twoor more 
regular staff teachers, one or more aides cr secre- 
tarles, and in some cases an intern. The number 
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Figure 3: Organizational chart of a multlunit school of 600 students 
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of instructional staff varies with the size of the unit. 
The Intern assumes instructional responsibilitles 
and does not perform routine and clerical duties. 
Each unit [6 charged with planning and conducting 
the total school experience of about 150 students in 
the prototype shown in Figure 3, 


At a second level of organization, the principal 
and the unit leaders constitute the per manent Instruc- 
tional Improvement Committee of the bullding. The 
principal chairs the group, which meets weekly, 
more often lf necessary. This committee may bring 
in consultants from the central) office, the state ed- 
ucation agency, or other agencies. Instructional de- 
clsions made by the committee are executed in the 
units. 


At the third organizational level is the Syste m- 
wide Policy Committee. Chaired by the super intend- 
ent or his designee, this comnzittee includes repre- 
sentative principals, unit leaders, teachers, consult- 
ants, and other relevant central office staff. The 
personnel of this Committee have the capabilities 
and speciatization necessary to rssist the staff of the 
Multiunit School. The Committee meets less fre- 
quently than either of the other groupe, but its oper- 
ation is one key to the success of the Multiunit 
School. 


The organizational pattern of the Multiunlt School 
thus differs from that of the traditional, seif-con- 


tained classroom school in several ways. First, In 

the Multiunlt School personnel work in unitsorcom- 
mittees, rather than in isolation as Is the case in 

the traditional school. Second, three new roles are 
added: unit leader, teacher aide, and Instructional 
secretary. Finally, the addition of new roles and 

the use of personnel In groups rather than alone re- 
sults in considerable redefinition of the familiar 

roles of principal, teacher, and consultant. 


In individually guided education in the Multiunit 
School, the Instructional Improvement Committee 
determines the objectives for the particular school 
building, taking into account system-wide and state 
regulations. These are broad institutional objec - 
tlves for the school building. The staff of each non- 
graded Instruction and Research Unit, the replace- 
ment for the graded homeroom or self-contained 
classroom, then decides the objectives for each 
child in the unit. While the unit leader takes the 
initiative here, each unit teacher also participates, 
Assessment of the child’s characteristics isthrough 
observation and by means of locally constructed and 
standardized instruments of various types. On the 
basis of the assessment each child is then placedin 
one-to-one, small group, clase-size group, and unlt- 
size group activities. Instructlonemploying tu- 
torial work and coniputer-assisted instruction are 
examples of one-to-one activities. Activities in 
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small groups of two to fifteen are organized to at- 
taln socializing and alse skill objectives, Inconnec- 
tion with skill objectives, 150 childrenin a unit 
might be placed in fifteen small groups for most of 
their mathematics instruction and then regrouped In 
another fifteen groups for part of their reading in- 
struction, Class-size or homeroom activities are 
used for achieving any objective where heterogene- 
Ity is desired, Large unlt groups of 40 to 150 are 
formed mainly for giving Infor mation to the total 
group orfor Independent study. The information is 
given by a teacher, television, sound motlon picture, 
or by other means. Some music and physical edu- 
catlon activities are conducted in groups larger than 
the usual class size. Independent study ls carried 
out in small groups, cla6s-size groups, and large 


groups, 


During 1967-68 approximately 4, 600 students In 
the elementary school, 1,600 inthe junior high 
school, and 400 in the senlor high school were en- 
rolled In R and I Units in Wisconsin schools.. In 
these schools, children, educatlonal practitioners, 
behavioral scientists, aud other staff members of 
the Center are brought together in a close working 
relatlonship. Thus the selected schools of Wiscon- 
sin providing the facilltatlve environment comprise 
a primary link between improved school practices 
and Center research and development. 


DISSEMINATION 


The R and D Centers Is committed to disseminate 
the products of its research and development actlv- 
itles to appropriate personnel by varlous media 
and also to Install them in selected schools where 
others may directly observe the related educational 
practices. So that the Center may fulflil its obliga- 
tion of improving educational practice natlonaily, co- 
operation with personnel in key organizations of the 
state and natlon is essentlal. An Internal informa- 
tion section and an external network involving the 
Center and other agencies were established, start- 
ing in 1964, and are being extended inorder a) to 
transmit information directly to scholars and others 
through Center supported publications, conferences, 
etc. ; b) to communicate information to personnel of 
selected school systems and school-related educa- 
tional agencies regarding the outcomes of the Cen- 
ter’s programs as they become ready for disseml- 
nation and school use; c) to distribute knowledge re- 
garding cognitive learning and products to agencies 
that function as linking mechanisms with schools; 
and d) to receive from the other agencies in the net- 
work information that may be used to improve the 
Center’s products and operations. 


Reports of research and descriptions of develop- 
mental activities are disseminated through various 
publications. In addition, allinstructional programs 
and procedures produced and tested by the Center 
may be observed In selected schools, TheCenter is 
working with other agencles to assure statewide and 
national dissemination and adoption of Center prod- 
ucts. The State Department of Public Instruction of 
Wisconsin, regional educational laboratories, Title 
Land Title I programs of ESEA, local schools of 
Wisconsin and other states, agencies of The Univer- 
sity of Wisconsin, and the private sector are all in- 
volved in the dissemination network. 


The Center’s publication prograr: carried out by 
the Office of Information Services has four major 
components ~ Techical Reports, Theoretical Papers, 
Working Papers, a Newsletter, and books. Techni- 
cal reports desc:lbe the rationale, methods, and re- 
sults of original esearch conductedby Center staff. 
Research reviews, siatemeiits of theoretical posi- 
tion, and descriptions ari rationale for project de- 
velopment are the couteit of theoretical papers. The 
theoretical papers are form: documents that, Ilke 
technical reports, may be classifled as monographs. 
Practical pape:s contain infor mation of immediate 
significance to educational practitioners In establish- 
ing or extending instructlonal programs — guidelines 
for beginning new programs, outlines and specific 
procedures for Instructlon, evaluation summarles 
and procedures, and progress reports of projects 
conducted in the schools. Working papers present 
plans and procedures for initlating and executing re- 
search and development activities. 


Analyses of Concept Learning edited by Herbert 
J. Kiausmeier and Chester W. Harris and the pres- 


ent book are collections of papers read and discussed 
at the Center. The first, from a conference of the 
same title, was published by Academic Press in the 
fall of 1966. The second, from the Center colloqui- 
um series, was published by De mbar Educational 
Research Services in 1968. 


TRAINING ACTIVITIES 


Three conditions indicate the needfor a high 
priority to be given to the training of personnel in 
educational research and development in the R and 
D Center. First, the natlon needs a large number 
of able persons in educational research and develop- 
ment. The many new programs under the ESEA of 
1965 and others originating in the various states am 
local school systems require research and develop- 
ment personnel as well as knowledge and solutions 


to many educational problems. Second, The Univer- 
sity of Wisconsin has both atradition and the re- 
sources to contribute te the training of educational 

researchers, particularly beyond the baccalaureate. 


The University has strong graduate programs 
through which students acquire knowledge and skills 
essential for educational research. Third, the R 
and D Center at Wisconsin !a the largest agency in 

the Midwest with educational research and develop- 
ment as its primary functlon. 


The informa) training of educational researchers 
and developers to supplement the formal programs 
in the various instructional departments and col- 
leges, has been a signifieant contribution of the Cen- 
ter to improving education through research and de- 
velopment. For example, during 1966-67, informal 
training was provided for four postdoctoralfellows, 
sixty-three graduate students employed part time 
by the Center, ten ESEA Title IV doctoral fellows, 
ten NSF fellows, five NDEA fellows, several Univer- 
sity fellows, and forty-two learning specialists em- 
ployed by the public schools. Twenty-elght persons 
affiliated with the Center were awarded PhD’s by 
the end of 19€7 and are locaied throughcut the coun- 
try ina variety of leadership positions. A large group 
of persons has been awarded the Master's degree also. 
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TECHNICAL SUPPORT 


The primary components of the Technical Section 
aze a measurement and design group; production 
specialists; and computer experts. The design 
group provides assistance to the research personnel 
on mutters of research designand evaluation. 
Equally important, this group is continuously devel- 
oping new designs to mect the needa of the Center 
and retining statistical procedures for the analysis 
of data. A measurement expert provides assistance 
on problems of measurement and develops more ef- 
{ictent measurement tools and procedures. Comput- 
er specialists coordinate data analysis, from the 
conversion of rew data to computer compatibleform 
through the presentation of the processed data in 
tablos and graphs, and assist inthe application 
of computer technology to educational research and 
development. A curriculum specialist assists the 
staff in WKdentifying and using appropriate reference 
matertals and in the production of graphical matert- 
als. Production experts assist withthe development 
of Instructionai, experimental, and informative ma- 
terials in the various media. 


STAFF 


Execution of the Center programs fequires 
proper interdisciptinary staffing. This Center sud- 
scrivea to the philosophy that the most productive 
research and the development of effective Instruc- 
tional eystems will derive fromteams composed 
primarily o behavioral sctentists, subject-matter 
epeclalists, and experts in curriculum and other 
areas closely related to educational practice. The 
behavioral scientist ecatridutes hia research skills 
and knowledge of fundamental processes in cognitive 
learning; the subject-matter speclalist provides 
knowledge of the subject field; the experts incurrk: 
ulum and other fleids ¢ ontrfbute knowledge about 
methodology and other relevant instructional yaria- 
bles. 


Rudies of cognitive learning, included in Pro- 
gram I, are hoaced by behavioral scientists con- 
cerned primarily wlth synthealzing and advancing 
bnowledge in this area. The other experts contr b- 
ute to these studies as team members when cogai- 
tive processes related to spect subject conten. 
are studied. tn Program 2 in which processes of in- 
sirociion ate studied avai i.siruclional programa 
are developed, the proje«ts are headed by subject- 
matter or curriculim spec lal'sta concerned with de- 
veloping an instructional syecem io a sutject area, 
however, a behavioral scientist is a me.tber of the 
team, Experts ia echool organization and the gocl- 
ology of groups are involved with cther staff in the 
development and mainenance of the facilitative en- 
vironments, Program 3. Commenication special- 
Ists Carry oul the dissemination program. 


This mutually beneficial involve meat of the staff 
has two nateral consequences. Firat, the basile 
stadies in learning are concerned with developing 
knowledge that is relevant to educational practices. 
Second, the studies of Instrectional proce sees aad 
the instructional prodects that are developed in Pro- 
qtam 2 hare a scond foundation in the behavioral act- 
ences and the subject discipiincs. 


In addition to the Center staff, many outstanding 
interdisciplinary groups are available within the Unl- 
versity for Cooperative planning and execution of ac- 
tivities. Personne) from three of the outstanding ac- 
thvifies in The University of Wisconsin are continu- 
ously engaged in consultation andteam work with 
the Center staff: WHA-TV, a foremost producer of 
educational TV progr? ms in the nation; the Survey 
Research Laboratory, 1 large and distinguished in- 
terdisciplinary survey team; and the Computing Cen- 
ter, one of the best In the nation. Thus, the Wiscon- 
sin R and D Center does not require a large perma: 
nent Staff in each of these areas of specialty. Rather, 
programs and activities are planned and executed 
cooperatively as part of the total University of Wis- 
consin contribution to improvement of education 
through research and development. Other relevant 
interdisciplinary centers and laboratories atthe Uni- 
versity Include the Center for Demography and Ecot- 
ogy,  sCummunications Research Center, and a 
Socia system Research Institute. 


Twenty-two persons of professorial rank were af- 
(iliated with the Center, 1967-68. The departments 
In which they held rank inctuded Computer Sctence, 
Curriculum and Instruction, Educational Administra 
tion, Educational Policy Qudies, Educational Psy- 
coology, English, Psychology, Soctology, and 
Speech. Some professors held rank in two depart: 
ments. 


ADMINISTRATION 


Administratively, the Center is located inthe Ual- 
versity’s School of Education but draws upon the en- 
tire University for human and cther resources. The 
working relationship between the Center andthe Uni-+ 
versity Is manifested in three ways: professors in 
various University departments are members of the 
Center's Facuity; both the Dean of Education andthe 
Chancellor of the University are involved in review: 
ing the Center's activities; and University officials 
serve on the Center’s Executive Committee, the 
Polky Review Board, and the Advisory Council. 
Figure 4 outlines the administzatfon and manage- 
ment of the Center. 


The Center Director is reeporsible for planning 
the total Center program and Its broad stretegles. 
A directoe of the research and ‘velopment pro- 
grams, aditector of disseminat o::, adirector of 
operations and business, and a director of a technl- 
cal section, with the Center Director, comprise a 


Manage ment Council. 


The Execatirve Committee inakes recommenda: 
Uions regarding policiea, programs, and budget. B 
consists of the Center IMrector, who ls also the 
chairman, thrce members elecied by the Principal 
Investigators, and three members appointed by the 
Dean of the School of Education. 


A Faculty of Principal investigetota, consisting 
of professors in various University departments, 
participate in the Center's program derelopment, 
and they plan and exeewe the Center's project a. 


The Policy Review Board brings the necessary 
Univer ality reacorces to bear upon the problems 
which the Center is interested Insolving. The 
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Figure 4: Wiscorsin Research and Development Center for Cognitive Learaing organization chart 


Center Advisory Council 
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Commitiee 

Joint Committee of State 

Dept, of Public Instructi 


Cisectot, Research and Development 
Programs 


Processes and Conditions 

of Learning 

Program 2: Processes and Programs of 
Instruction 

Program 3: facilitative Environments 


frogtam 1: 


Faculty of Princinal 


Board is composed of representatives from the of- 
fice of the Chancellor of the Madison Campus; tue 
deans of the School of Education and the College of 
Letters and Science; the Director of the Wisconsin 
im provement Program; the Superintendent of State 
Department of Public Instruction; a member uf the 
Wisconsin Coordinating Com mittee for Higher Edu- 
Calton; the Executive Secretary of the Wisconsin Ed- 
weation Association; three departmental chairmen of 
the College of Letters and Science and the School of 
Education; cad the Center Director. The Board an- 
tually reviewa the Center's mission, organization, 
programs and stafling; recommends overall policies; 
suggests funding levels. 


A National Evaluation Committee confers annual- 
ly with Center personnel on the Center's progress. 
The Committee consists of nine individuals of nation- 
al reputation interested in the problem area of the 
Centet and committed to the Improvement of edaca- 
thon Uhtough research and development activities. 


The Center Advisory Cowncil, composed of off!- 
cers of the University a representatire of the 
Wisconsin School Board Assacistion, meets once & 
year to analyre the Center's progress and to advise 
on matters in need of attention. individuals of six- 
teea school systems, including public and parochial 
schools and a technical institute, are included. 


President, University of Wisconsin 


Chanceilor, Madison Campus 


Dean, School of Education | 


Director, R & D Center 


Director 
Dissemination 


External 
Contacts 


R & D Support 


investigators 


University 
Policy Review Board 


Executiva Committee 


Director 
Operations and 
Business 


Director 
Technical Section 


Administrative 
Liaison 


Methodological 
Research 


Logistic Support 


R & D Support 


LOCUS OF OPERATION 


Recause the R and D Center Is effectively inte- 
grated Into the University complex, both on an ad- 
ministrative and disciplinary level, itis natural 
that the Center program incorporstes th: pallosopty 
of The University of Wisconsin regarding the Im- 
provement of suclely through research, develop- 
ment, and training. “his philosophy is best ex- 
pressed in a wkely quoted statement: 


Whatever may be the limitations which 
trammet inquiry elsewhere, ee bclieve that 
the great state University of Wizconsin should 
ever encourage that cortinual andlearless 
sifting and winnowing by which slone the truth 
can be found. (Taken from a report of the 
Board of Regenta in 1894.) 


President Barrington has from ihe beginaing im- 
plied the extension of these concepis to educational 
research through the R and D Center, and he contin- 
wes to gire generously of his time to assist the Cen- 
ter in achieving (8 goals, and to aseure 8 Climate 
in which the Center may operate nore effectively. 


The Medison Cr npus of The University of Wis- 
consin Is the foremost research agency in the state 
and is among the leadicg research-orlented univer - 
sities in the world. The commitment to educational 


‘<) 
ERIC 


THE WISCONSIN RESEARCH AND DEVELOPMENT CENTER FOR COGNITIVE LEARNING 155 


research is substantia) as may be inferred from a 
statement by then Chancellor Robben Fle ming on 
July i, 1965: 


With sc + ach emphasis on education tn to- 
day's wor,» .t would be easy to drift along the 
well-maraed paths of the past. The strength 
of our School of Education lies in its restless 
innovation. In cooperation with the schools of 
the state, it is forever trying new ways to [m- 
prove the primary and secondary schools. In 
residence its curriculum is marked by an un- 
ususl degree of cross-fertilizgstion, and by an 
interdisciplinary faculty. Nsresearch {fs 
probing the frontiers of the learning process, 
asking, In effect, whether we are On tie right 
path to begin with. 


tmple ments’ ion of the philosophy imptied in the 
Preceding statements as applied to the RandD Cen- 
ter has been demonstrated in two notable ways. 
First, the Policy Review Board of the Center, the 
most powerful governing agency of the R and D Cen- 
ter, ts chaired by James Cleary, Vice-Chancellor 
cf Academic Affairs. This Board reviews the pro- 
gram of the Center and takes maior responsibility 
for assuring adequate staffing of the Center tn light 
ol its program. The second example of implemen- 
tation Is that the actual state support, not an ind\- 
tect contribution, to the Center has increased from 
approximately $10, 000 in 1965-66 to $308,000 iz 
1967-68. This state contribution is used almost to- 
tally to pay the salaries of principal investigstorsof 
the Cemer - professors who hold appoint ments Inan 
academic department of the University and sre budg- 
eted fifty percent or more In the Center, 


The School of Education is committed to the phi- 
losophy Uthat the continuous improvement of public 
echool education requires unceasing research and 
related activities. Dean McCarty, shortly after ar- 
rival al the University in 1966, indicated that the 
R and D concept is the most significant educational 
innovation in recent decades and tat allforms of 
worthy educational research merit support. Three 
of many posatdle examples point tc the high priorl- 
Hes given to educational research and related activ- 
itles at The University of Wisconsin. First, 
$4,024, 298 was expended oneducstional re- 
search and program experimentation in 1965 through 
the School of Education. The four sources of the 
fuppott were Federal agencies, the Sate of Wiscon- 
sin, private organizations, and local school systems. 
Second, tn the first seven years of the Cocper ative 
Research Program of USOB, the University was 
awarded grants for thirty-three projects. Third, 
the smount of state support for research tothe 
School of Education increased from $294,963 in 
1964-65 to $804,976 in 1966-67. 


The interdisciplinary nature cf the School of Ed- 
ocation [8 &@ major factor in the eminence of the Uni- 


versity in educational research and related scli¢kies. 


tn 1968 the membership in the School of Education 
was 1,075 professor sirora eerenty-teo departments 
of the University. Graduate work in preparing ede- 
cational researchers is interdisciptinary. Profes- 
sors in many departments of the Unirersity offer 
courses taken by graduate students pursuing pro- 


grams to prepare for educatlonal research. I'urther, 
many PhD candidates In the various departments of 
the School of Education pursue minors indepart= 
ments of the College of Letters and Sctence while 
many PhD candidates In Letters and Sclence pursue 
minora in departments of the School of Education. 


SOURCE ANO STABILITY 
OF FUNDING 


Any organization requiree stable funting over 8 
perlod of years in order to secure excellent staff at 
reasonable salary levels. Stability of funding was 
an Important consideration in starting the Center, 
This Center, in line with the general USOE policy, 
was awarded a 5-year grant, starting September J, 
1964, by the USOE with three important provisions: 
First, that the contract would be amended annually; 
second, that, tf for any reason, it became necessary 
to discontinue the Center the phasing out process 
would be sccomplithed over & period of time mutually 
satisfactory to The University of Wisconsin and 
USOE; and third, in the fourth year, the schleve- 
ments and op?rations of the Center would be evalu- 
ated comprehonsively in order to arrive at adeci- 
sion regarding 8 second $-year period, The Center 
was awarded ipproximately $500,000 for the first 
year of operation. Each amended contract for the 
next three years showed a modest Increase in the 
level of support. 


The second source of support fs the State of Wis- 
consi. through The University of Wisconsin. Ar 
noted earlier, some monies sre made directly avall- 
able to the Center. This Is, however, nol the main 
University support. The largest support lies in the 
availability of personnel to the Center - administra: 
lors, peofessors, graduate students, and classified 
personel = and also other personnel in specialized 
{leis such as computer science, opinion survey, 
TV production, and equipment development. The 
University also has leased a facility and provides 
the many services that sre necessary to make an 
operation furction well. 


Although not s d'rect source cf funds to suppert 
Center activities, the staff of four kcal achool sye- 
lems, particularly the subject-matter consultants, 
the building principals, and unit leaders, give con- 
siderable time to refining the concept of Individually 
guided education In multlunit schools. Also, ideas 
and inhorstions of the local sciools and the R and D 
Center are demonstrated through Title Il projects 
in local achools. The Sate Department of Public tn- 
struction is the printipal disseminster of Rand D 
field-tested idcas and materials in Wisconsin. 


CONCLUDING STATEMENT 


The preceding description of the Wisconsin Re- 
search and Development Center for Cogritive Learn 
ing was written late in the thitd year of the Certer's 
existence. Ris antkipeted that there will pol be 
sharp changes daring the next decade tn any of the 
eighM major components: prodiem ares, outcomes 
sought, research and development programs and 
strategies, dissemination program and stralegics, 
pattera of staffing, pattern of administration and 
management, locca of operations, and source and 


i i ip same ae a a a 


re) 
ERIC 


156 RESEARCH AND DEVELOPMENT TOWARD THE IMPROVEMENT OF EDUCATION 


stabllity of funding. Though sharp changes are not 
expected, continuous Improvement in sll of thegze 
Areas is encouraged, Annually the Executive Com- 
miltee of the Center evsluates cach program and 
project and the related strategies. The Nations! 
Evaluation Committee gives particular attention to 
the significance of the problems being attacked and 
the sdequacy of the strategies being employed. The 
University Policy Review Board examines all ele- 
ments of the Center activities but gives particular at- 
tention to proper staffing. Fleld visitors appointed 
by USOE officlals, and USOE officials also evaluste 
all components of the Center. University officiats 
ag individuals, consultants invited by the Center 
staff, and school people provide evaluative informa: 
iion, The information from all sources is carefully 
analyzed dy all the Center s.a/f, but particularly by 
the Executive Committe:, Management Council, and 
Director. Annually, the Information ts formally put 


into program plans for the ensuing year. Changes 
are also made as essential at any time during the 
year. When sny element does nct function properly 
or produce at s reasonably high level, it is modified, 
The Center now demonstrates higher productivity 
and moze sophisticated strategies than a year ago. 
Its improvement mechanisms are designed to accel- 
‘rate these trends. 


FOOTHOTE 


1, Miss Elizabeth Schwenn, Project Assistant, as- 
sisted in editing this chapter, The Executive 
Committee and Management Counc tlof theCen- 
ter contributed to the program description of 
the Center and the various faculty and thelr 
research and development staff are responsi- 
ble for the results as reported herein. 
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meee An Output-Oriented Model 
of Research and Develop- 
ment and Its Relationship 
to Educational Improvement 


FOR SEVERAL months Ihave fotlowed 
the pages of Science stlending to the continuing dis- 
cussions of research and science policy, generally 
concerning myself with the degree to which the gol- 
key questions which arise in educations! research 
and development c8n, must, or ovght to be con- 
sidered ss & subset of those which arise for science 
as awhole. Thus it hag been with no small degree 
of interest thal I have read the articles prepared by 
Philip Handler (1967), George Daniels (1987), Har- 
vey Brooks (1967), Lee DuBridge (1967), and Mi- 
chae) Reagan (1967). 


Coine Wental to this continuing dialogue 1 have 
beenfor the past P years engaged ins general ef- 
fort to Improve the quatity, effectiveness, and im- 
pact of the total research effort in education. No 
smal part of that Ume has been spent grappling in 
peactice with many of the same kinds of issues 88 
receive explication in the articles eked above. For 
some months [ have beer thinking about research 
and development in educstion trying todevelop a 
model which would express the diferent functions 
within the total research effort, the various sources 
of Initistive for these different kinds of sctivity, and 
the relationships smong both the functions and the 
sources of initiative. My thinking has, of course, 
been la no emall measare etimelsted by recent de- 
bate about the ways in which echools, instrection, 
and educstion are likely to be Improved most Qakk- 
ty and with the most substantial cumulative and k .t- 


Ing Impact. 


Revlewing the severg] sistements cited sbove in 
terms of their genersl usefulness for spotlighting 


i) 

Hendrik D. Gideonse 
United States Office of Education 
Washington, D.C. 


and Clarifying anslogous problems in the fleld of ed- 
vestions] research revesied the particular vshue of 
Reagan's anslysis as a summary of points of view 
already sdyanced ard 88 an Wentificstion of the gen- 
erslly individualistic starting point of many of the 
theoreticians of science and research policy. The 
model presented in this article constitutes, f think, 
an instance of exsctly thst for which Reagan Called 
(1967), namely, 8 discussion of research snd dere)- 
opment 88 seen and understood from the point of 
view of someone who sees himself 88 8 sponsor or 
user of research snd development to achlere certain 
broad purposes ins particular fleld of human actir- 
tty. ft was not developed directly Inresponse to 
Reagsn’s suggestion; infact, it was only after 8 col- 
league recalled his artkle with specific refereme 
to the similarity of view on the research and devel- 
opment distinction that [ realized bow ¢lozely what 
1 had for mulsted came to responding to Resgsn's 
suggestion for more dialogue on the part of users 
of research to more adequately balance that which 
had been genersted by the performers, 


The Cuba-Clark Model 


Typically, the context for the debate sboet re- 
seatch and development for educaltionis s discussion 
of the change process in edacstion. Vsrious models 
of change have been proposed. The one which seems 
to have the kighest degree of currency ia education 
sithe moment places research, development, sad 
disseminstica ins linesr arrangement beginning on 
the left with inqgeiry (research) and proceeding to the 
right through development, diffusion, and edoptbea 
(sez Figare 1). In proposing the model Egon Guba 
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and David Clark (1965) called three caveats to stlen- 
tion. Firat, they noted that the modelwsasconstruc- 
ted on logics! grounds and that it was largely unsup- 
ported by empirical research. Secord, they pointed 
out that it was not necessary for change to begin st 
the research or Inquiry stage. Third, they noted 
that the model itself was 8 uni-dimensional analysis 
of change roles which are influenced by a multi-di- 
mensional range of variables not entirely accommo- 
dated by the model's structure, 


As a model of the change process, this parlicu- 
lar schema is simple and logical. However, those 
of us who have worked Intensely on problems of re- 
search policy in education see some shortcomings. 
The Guba-Clark model does nat emphasize suf: 
ficiently within its structure that tniliative for action 
of quite different kinds can take place st any point 
in their continuum. Because of its linear nature, 
and despite the second caveat mentioned above, the 
model unwittingly implies that innovations begin with 
the findings generated by fundamental research. 


The Output Model 


The purpose of developing an alternative model 
is to create s heuristic which a) illustrates the es- 
sentla) differences between research and develop 
ment activities and b) shows how the two are + or 
can be ~ related to one another and to the oper ating 
educational system. Suchs model ought to illustrate 
the different sources of Initistlve and motivationfor 
beginning various activittes. HR should be sable to 
show or imply the Interplay smong all the functions 
in the effort to improre instruction. 


The model developed is based on the conviction 
thal research, development, and school operstions 
are different kinds of activities with quite different 
odjectives or outputs. Mt indicates that Initistives 
for each kind of activity sre the results of decisions 
based on quite different kinds of dats and equally dif- 
ferent kinds Af internal and extecnsineeds. The 
model implies that while there may be a strong log- 
ical flow from the production of knowledge through 
the development of processes to their installathoa In 
operations gettings, there may be just a8 etrong 8 
flow backwards ss operational problems define de- 
velopment programs, which, Inturn, reveal the 
need for certain basic information and theory. 


Figure 2 expresses the model. Three planes sre 
shown, each symbolleing the different of lentation of 
activities Conducted ander research, development, 
and school operations. (The model is - a8 are sll 
modela ~ an asdstraction from reslity. tn the res} 
world these activities are not sways nestly se ps- 
rated elther In time or location. The point of con: 
Cepluslly - and therefore graphically - separating 
them bere Is to illustrate the essentially déferent 
orlentations of the three types of activity and the 
consequences of those differences.) For each ac- 
livity represented in Figure 2, the model depicts an 
tnftlative leading to an output charactertetic of that 
actlyHy. 


The lower plane symbolizes (he tnowledge orien: 
tation of recearch. The odject & research isto 
generate new knowledge. One of the significant fes- 
tures of research is that when an activky 1s begun 


the specific oulcome is not known. For research, 
C represents an initistive undertaken which culmi- 
nates in s research finding represented by Fe. 


The middle plane symbolizes what I call the proc- 
ess orlentation of development. The objectof devel- 
opment is to produce materials, techniques, proces- 
ses, hardware, and organizational formatsfor In- 
struction which accomplish certain pre-specified 
objectives construed to be part of the broader goals 
of education. One of the signficant features of de- 
velopment Is that when an activity ls begun, the ob- 
jective is known or established af the outset. The 
obdjectives for s development project are cast in the 
form of performance specifications (PS), and sll ac- 
tivities are geared to producing the necessary prod- 
ucts and processes which will meet those specifics- 
tlons. In Flgure 2, B indicates an initiative under- 
taken for development culminating tn the cresttor of 
8 process which meets performance specifications 


The top plane symbolizes the activities character- 
Istle of school operations. The operating educstion- 
8] system is production oriented. Thus, the odject 
of echool operations Is to act upon human be ings In 
order to train and develop in them various skills, 
attltudes, beliefs, and krowledge cakulstedtoserve 
doth society and themselves, Certainly one of the 
significant features of initiatives in &chool operations 


Figure 2, An ovlput model of educations! research 
and derelopment 
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Ja the weight of the responsibility on Ihe school ad- 
ministrator for choosing the right kinds of proces- 
6e8 to achieve the oulputs that society and 
als specify. In Figure 2, A represents an initiative 
to Instsil a process leading to the production of ed- 
vcation output EO,. 


A ‘Wak-Through'’ of the Model 


To Itlustrate the relationships among the three 
types of activities, consider the following example. 
A responsible school official, faced with evidence 
that certain outputs desired by the soclety are not 
being achleved for a significant portion of the chil- 
éren in his charge, searches other school operations 
and ongoing of completed development projects for 
processes designed to meet his need, Should hefind 
nothing to sult his particular problem (e.g. ,the low 
reading schievement of culturally disadvantaged chil- 
dren}, he may then exercise his prerogative to call 
for the initistion of a project to design and derelop 
& process whose performrnce specifications are 
such that upon lastallation of the process in his 
school, it will ylekd the desired educstional output 
le. g., Increased level of reading achierement inthe 
target population). 


Once the initlative for the development project 
has been undertaken and the performance specifica- 
(ions established, the development project th..n con- 
ducts a search for relevant research findings ~ atch 
may offer clues lo guide the development project. 


Figure 3. A'‘Watk-Through’’ of le model 


(Whelher of not this step is tsken after the project 
is begun or Immediately before it Is not really im- 
portant. What is ceuctal is thal at aome polnt near 
the very beginning of the effort sucha search is 
made.) Impressed with a particular finding (e.g., 
the tremendous Impact of parentalattitudeon student 
achievement aa revealed by the survey conducted as 
part of the Plowden study), the project may decide 
to develop a process which deliberately tries to en: 
gender a large measure of parental involvement In 
home Instructional experiences carefully geared to 
complementary experlences in the school setting. 
Having made that decision the developers may then 
discover that they require further infor mation about 
the specific nature of opimum parent-child interac: 
thons to stimulate maximum learner achievement. 
They may Iherefore call for a specific inittative of 
a research aclivity to generate further datato guide 
the development of materials. When useful findings 
are identified they can be Incorporated in the devel- 
opment effort which then proceeds to successful con- 
clusion. When, using Iterative techniquesofdesign, 
development, trial, and redesign onthe basis of 
feedback, materials encompassing both school ex- 
perlences and parent-child Interactions in the home 
are successfully developed and validated, they may 
then be transferred to the operating setting where 
the administrator may install them as part of his 
instructional program. 


This example is illustrated in terms of the medel 
by Figure 3. EO, at No. 1 symbolizes the social 
demand for a certain kind of educational cetput (in 
the example Just given, higher redding ach. “Te ment 
for cokurally disadvantaged children). Thisc m.°4 
Creates pressw-e on the school admisle'rsior to re- 
spond with some sort of Initiative. Thal \nWlative 
Is represented by A at No. 2. Raymbolizes hit 
search for an effective process to install. Since he 
did not find It, Ais response wes to call for a devel- 
opment inifiative (B at No. 3). The next step was 
to derelop the perfor mance specifications (PS, at 
No. 4) such that they correspond to the educational 
output desired ty society. Once the spec fications 
for the development project are established, the next 
step is to eurvey related research seeking guidance 
for the developmert effce' The search is conducted 
and the finding (Fr_) of relevancs to the perfor m- 
ance spec ications and the desired educational out- 
pet (e.g. , the significance of parental attitude) is 
incorporated into the development project (No. 5). 
The Call fot additional research assistasce is sym- 
bolized by D at No. 6 and the incorporation of rele- 
rant findings {again Frx) from that Initlative into the 
Gerelopment effort is symbolized by the oc.Xi arrow 
to the development line at No. 9. Number $ repre- 
serts the completion of the developmen project, No, 
9 the incor poration of the process into school oper- 
ations, and No, 10 tbe production of the desired out- 
put, higher levels of reading achievement, a8 a ¢oa- 
sequence. 


A Sam a t Possfhle inter 8 
The depiction of a sampling of other possible ia- 


teractions among researca, derelopment, and oper- 
ationa can be found ia Figure 4. 


Exampte: A school official feels the need to as- 
sess the degree to whichinstructional programs are 
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Figure 4. A ssmptingofother possible Interscllons 


serving 8 particular largel population. He calls 
therefore for an inilistive in research. This is rep- 
resented by the D/D/F-F Interaction. 


Example: An organization engaged in devetop- 
mem independently concludes that It would be useful 
to develop 8 certsin process of product for instruc- 
thea, This is represented by the B/PR, Interaction. 


Example: Research is Initiated for Ks own sake 
and pursued solely for the knowledge which it peo- 
daces. No findings have yet been Incor porsted 
either In development of operations. This is sym- 
bolized by the C/F-F-F relation in research. 


Example: Research initiated for its own sare 
yields the findings that certain organizational sirec- 
tures for large city school systems are always peob- 
lema ‘cal or that s certata vitamin supplement ad- 
ministered between the ages of § and T can prevent 
aform of mental retardation those appearance ¢can- 
not be detected entll somewhat later. Neither one 
of these findings needs to pass through development, 
Each can be Implemented directly Ih school opers- 
trons (if ao desired), This kind of relathonsalpof re- 
search to practice Is illuste sted by the GG F- F/F/EQ, 
Wetter action, 


Example: Finally, consider an instarncein the 
form of the linear flow or Guba-Clark model from 
research to development to implementstiom Re- 
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search on early childhood and cognitive growth, for 
example, uncovers 8 number of findings some of 
which may suggest the development of processes 
and environments which can actively ernance such 
gresth. Development efforts are consequently sup- 
ported and carried through to completion. The avall- 
ability of the resulting products and processes is 
made known to educational administrators who are 
thereby persuaded to Incorporate the newly devel- 
oped early childhood instructions! programs, at 
either private or publile expense, Into (he Nation's 
educations! system. This kind of sequence is rep- 
resented by the J/F-F-F/K/PSj/L/EO; interaction. ‘ 


THE MODEL AS AN HEURISTIC 


All of these representations In Figures 2, 3, and 
4 are fairly obvious and straightforward. The use 
of the model as an heuristic, however, profits from 
further explanation. One of these uses pertains dl- 
rectly to the problem of ‘‘change process’’ as sp- 
plied to education. The modelis structured to illus- 
(rate that the incor porstion of research findings in- 
to derelopment is just 88 Important and oftentimes 
as Gifficult a proposition ss incorporating newly de- 
veloped processes Into operations) settings. The no- 
Uon that there are obligations on beth research and 
Gevelopment to transfer thelr “products” to other 
activities means (hal each must pay careful attention 
to the way in whith iis outputs are presented and, 
perhapa the very way in which the outputs are pro- 
duced. in other words, the requirement that even: 
tually there be transfer or incorporation into anoth- 
er type of activity places constraints upon the pro- 
fessional behavior in each activity which cannot be 
ignored without compromising lster impact. 


This requirement is particularly lrue for derst- 
opment projects, bul it is sslrue for research ac- 
livities. A few concrete examples Ilhustrate the 
point. One such exampte Is the researcher who pub- 
lishes his findings in 8 sloppy or difficull for mat 
and thereby hinders the likelihood of tic!s being ir- 
corporsted ultimately Into practice. The research- 
er who inadvertently concesls or compromises 
bai methodology or design encounters similar prob- 

ema, 


Similarly, the final requirement for a derelop- 
ment project is that it be usable in operational - et- 
UIngs. The ultimate desire to Incorporate the devel- 
oped process in achoo! operations means that one of 
the performance specications for development 
must siways be the provision of procedures @each- 
ars’ manvals, trainig procedu:rs, etc.) for sccom- 
plishing the installation of the Innovations. M the de- 
velopment is endertsken without reference to that 
fact (J, in short, the requirement for transfer is 
not dullt into the performance spec Micationa), the 
Geveloper may well have rendered his product af - 
usable. Hence, for example, the desire to involre 
teache’s and other practitioners in the derelopment 
process stems from the need to have thete expertise 
and experience contineally represented. They con- 
stitete, effect, the embodiment of many of the op- 
erational constraints and possibilities in achools with- 
in which the finished process willoperate. There are 
other good reasons for involving teachers 88 well, not 
the least of them being the respectability lent to the 
project in the eyes of the practitioners st large by 
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virtue of the meaningful presence of teachers In the 
effort. This tast consideration isof no small Impor- 
tance in securing scceptance of the innovation In the 
profession at large. The nature of its importance, 
however, should not be mistazen; the Involvement 
must be meaningful and not merely window-dressing, 
for the respectability 1s lent by thelr presence only 
if thelr contributions are fully utilized and their rea) 
knowledge of what isor may be possible is thoroughly 
weighed in the development effort. 


One finst point might be made >.ut the model's 
portrays! of the possibillty for tra. ‘ers back and 
forth among research, development, -peratlo 
That is the obvious emphasis which neec tc be€ 
en to the problem of information flow ars the feed 
for catifully consider'ng techniques for installation 
of better knowledge i ' better processes into thelr 
Intended settings. Or... part cd this Ia the direct 
responsibility of the researchers and the developers. 
Those with obligations for consKering the entire 
R and D system for improvement need sleoto direct 
thelr attention to the diffusion process. 


A second feature of the model a8 an heuristic Is 
the way it helps to clear up part of the problem of 
distinguishing between basic and spplied research 
In education. ! The model clearly implies that basic 
research (stucies generated Independently inre- 
search for the sake of the findings slone) and ap- 
plied research (research conducted lo serve s par- 
ticular need identified by people engaged in develop- 
ment or operations) differ from one another peimar- 
ity in terms of the intent of the Initistor.* Thus the 
know ledge-orlentation of the basic researcher is 
central to his activity. Applied researc’ 18 slso 
supported for the knowledge which results from It, 
bul the initiator of the research knows to what in- 
atrumental use he Is going to put his findings. By 
degicting both spolied and basic research as similar 
kinds of activities, the mode) impliies that in and of 
Lhemselyeg they look very much alike. The proce- 
dures, the design, the sophistication must sll be on 
par either Isto be valuable. What élatingvishes 
the two from one snother, ff anything does, are the 
purposes for which they are initiated, * 


A Uhird feature of the model as an heuristic Is ite 
suggestion thal decisions to inttiste activities of 
eath of the three types are made according to quite 
diferert criteria and perhaps by Quite different pec 
ple. The fundamental scientific character of re- 
search suggests thal independent initiatives exer - 
cised there depend besvily oa advice from the aciesce 
community. Developmert projects, however, can 
aleo be independerdly tatiated, but decisions to be- 
gin these Kinds of activities are subject to advice 
from both research and operations, WA limited 
resources, deciding which needs to satisfy through 
development for exemple, those independently gen- 
erated by developers, competed to those stemming 
rectly from echool operstions, compared to those 
gtowing owt of research activities) becomes s pertk- 
ularly diffe prodiem., Finally, the kinds of tone- 
ly decisions reqeired of achool administrators at the 
operational lerel are made by peopte fa the context 
of stil different circemstances and institetions, By 
emphasizing the essentially different natere of the 
activities being endertakea, the mode] reminds the 
policy maker of the need to collect different kinds of 


data and statements of need when planning future 
activities. 


Finally, the frank attempt to represent each of 
the activities In terms of particular kinds of oulputs 
may well be the most significant sspect of the model. 
It forces the viewer of the model to consider what 
the outputs of each activity are and to think sbout 
how the outputs of each activity are of use to one an- 
other. The outputs of research, for example, are 
knowledge. Some ci the knowledge produced through 
research will find sts way into development and Into 
school operation. Are there ways of Improving the 
output of research, making it more powerful, in- 
crease the likelihood of its being of use to instruc: 
tlon and education? 


What about the outputs of development? They con- 
atitute, on the one hand, the validation cf research 
and, on the other, the mesns by which the educs- 
tional system can improve the manner in which It 
carries out iis functions. How can development be 
Improved, how can research be organized to be of 
greater use to development, sod how can the educa- 
tional system Itself orlent its organization to the re- 
curring need for the installation of more powerful 
validated techniques? 


Finally, what happens to educations! operations 
when they begin to view ‘heir responsibilities 
In terms of oulpat? The contrast can perhaps de 
Most sharply drawn by conskering the implications 
of the notion of grading schools on the basis cf thelr 

& rather than students on the basis of thelr 

tformancte, The existing practke of grading stu- 
era assumes at bottom that the student ls respor- 
sible for his learning and that his fallure or success 
is a tridute or a consequence of factors intrinsk to 
him. The ides of grading 8 school onthe basis cf 
its Ou puls asrames Quite lo the contrary that a1 
Students can learn and that the responsibility of the 
schools 18 to make that happen. (We do tot, for ex- 
ample, judge the success or {silure of medicine or 
law by the patient's or client's end state; we judge 
Ht dy the degree to which the doctors ot lawyers 
skilfally wilized the most sophisticated peactices 
fa attempting to serve the client. We certainty do 
not grade” the patient or client; Quite to the con- 
trary, it is the professional services themselves 
which are asseseed. An oulputorlentsttion for 
e¢hool operations would cause the same reorienta> 
tion of the direction of assessment In education. ) i 
the schools (themselves ate fudged tn terms of the 
degree to which they are accomplishing their ‘'pro- 
ection goals," increasingly they may come to ori- 
ent their activilies to assessing their own ecfectirve- 
ness, identifying the techniques and procesces which 
heed improrement and, a8 a consequence, calling 
with increasing sophistication for the kind of derel- 
opment activity and research support WATCH will 
provide the basis for continuing Improre ment, 


FOOTMOTES 


1. The author Is Director of the Program Planning 
and Evaleation Stafi of the Burese ol Research, 
WS. Office of Education. Th's paper Is erk- 
ten in Gideonee’ private capacity. No official 
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support or endorsement by the U.S. Oftice of 
Education Is intended or should be inferred. 


2. This example is, of course, clearly an ideal con- 


ceptualization. It is instructive tokeep the 
model in mind ac one looks back over the past 
four years at the (tremendous developing inter- 
est in the establishment of early childhood 
educational programs. While it is certainly 
difficult Uf not impossible to establish an indi- 
vidual cause for such 8 complex phenomenon, 
it 18 nonetheless significant, ee An aed 
jam'n Bloom published his volume Sts it 
and Change in Human Characteristica (1064) 
just at the time the Office of Economic Oppor- 
tunity was beginning its planning toward the 
development of programa tofight the war 
against poverty. The significant thing about 
Bloom’s volume, however, was thal while his 
conclusions firmly underscored the impor- 
tance of the early years in the development of 
cognitive skills, he also pointedly observed 
that there had been Little actual experimenta- 
thon designed to create environments to en- 
hance such skill development. I do not think 
that it does violence to Bloom's argument to 
interpret it as a call for rigorous development 
efforts designed to produce environments and 
instructional programs which have the effect 
of enhancing human capabilities. The prob- 
lem, however, is that which exisis in all e0- 
¢iul domains. There are large numbers of 
chiren now whom we cannot afford to ignore, 
and the consequence has been the sttemp to 
create operating early chikihood programs 
based on those convincing research findings 
without firet having gone trough a de velop- 
mentel stage. The result has been a some: 
what marginal impact on the target populstion 
despite the clear implications of the research 
summarized ty Bloom. 


3. Tthink it 1s also useful at this pointto recall 


Reagar.'s view that the socisl sciences precent 
something of a different pictare in regard to 
the distinction between baake and spplied re- 
search. As he points out (Reagan, 1967, 
Pp. 1385), no matter how abstruse and abstract 
ite practitioners attemge to become, social 
etience research is inherently related to 
potential applicstions. 


4. The inithator and perfor mer are, of course, not 


necessarily one and the same peraon or insti- 
tution, The actual initiator of the research 

project may be a school man, a developer, a 

researcher, or a research administrator. The 
performer of that research effort may or may 
hot hare the same eltimste purpose as the ini- 
Uatot in mind a3 he endertakes the activity. 

Thus, for exemple, it would be perfectly pos- 
stole for a research administrator to stime- 
late a series of reccarch activities relating to 
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reading which he views as applied research 
necessary for a development effort to build 
improved reading curricula, whilethe per- 
former of that research sees it as 8 basic re- 
search effort in perceptionor the psychomoior 
sklils associated with reading. 


5. This view, Ibelleve, fits fairly well with one 


part of Harvey Brooks’ analysis of the distinc- 
tions between basic and applied research 
(Brooks, 1967, p. 1706) when he noted that 
‘as definite categories, {the terms) basic and 
applied tend to be meaningless, but 88 posi- 
tions on & scale within a given environment 
they probably do have some significance." 
The principal shortcoming with Brook's snal- 
ysis, however, is that it proceeds almost en- 
{irety on the presumption that the distinction 
can be resolved by approaching it in some way 
from the researcher's point of view. My ex- 
perience in the administration of research, a8 
the model presented in this paper clearly in- 
dicates, leads me to believe that the research- 
er's view is only one of seversl which must 
be taken into account In attempting any analy- 
sis of the distinction between basic and applied 
research. The presence of rather different 
Criteria and alternative vantage points convin- 
ces me that Reagan's argurent for abandoning 
the distinction within research is much more 
persursive 8s is the suggestion that the eriti- 
cal categorization is that between research 
and development, 
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